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Preface 


These notes provide a quick and brief introduction to Fourier Series. The emphasis is not 
only on the mathematics but also on the history of the subject, its importance, its applica- 
tions and its place in the rest of science. 

I first learnt about Fourier Series as a student of physics. Together with several other 
assorted topics, they formed a ragbag course called Mathematical Physics from which, 
when the time came, real physics courses would pick what they wanted. A little later, 
as a student of mathematics I came across Fourier Series in the middle of a course on 
Mathematical Analysis. On each occasion, my teachers and my books (all good) managed 
to keep a secret which I learnt later. Fourier Series are not just tools for the physicist 
and examples for the mathematician. They are directly responsible for the development of 
nearly one half of mathematical analysis over the last two centuries. 

These notes have been consciously designed to reveal this aspect of the subject and 
something more. The development of Fourier Series is illustrative of a recurrent pattern in 
modern science. I hope the reader will see this pattern emerge from our discussion. 

This book can be used by a variety of students. Mathematics students at the third year 
undergraduate level should be able to follow most of the discussion. Typically, such stu- 
dents may have had their first course in Analysis (corresponding to Chapters 1-8 of Prin- 
ciples of Mathematical Analysis by W. Rudin) and have a good working knowledge of 
complex numbers and basic differential equations. Such students can learn about Fourier 
Series from this book and, at the same time, reinforce their understanding of the analysis 
topics mentioned above. More preparation is required for reading Chapter 4, a part of Sec- 
tion 2.5, Sections 5.2 and 5.4. These parts presuppose familiarity with Lebesgue spaces 
and elements of Functional Analysis usually taught in the fourth year of an undergraduate 
or the first year of a graduate program. At many places in the book the reader will see a 
statement like “Let f be a continuous or, more generally, an integrable function.” Here 
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there is a choice. If it appears easier to handle continuous functions, the reader need not be 
worried about discontinuous ones at this stage. 

Thus the material in this book can be used either to augment an Analysis course or to 
serve as the beginning of a special course leading to more advanced topics in Harmonic 
Analysis. It can also be used for a reading project. Some readers may be happy reading just 
Chapter 0 outlining the history of the subject: in some sense that captures the spirit of this 
book. Others may enjoy the several tidbits offered in Chapter 3. 

Two editions of this book have appeared in India before this Classroom Resource Ma- 
terials edition. I am much obliged to the editors of this series and to colleagues and friends 
H. Helson, A. I. Singh. S. K. Gupta, S. Serra and R. Horn for their comments and advice. 
The computer drawings were made by a former student S. Guha. I am thankful to him and 
to A. Shukla for preparing the electronic files. 


A History of Fourier Series 


A large part of mathematics has its roots in physics. Fourier series arose in the study of two 
simple physical problems—the motion of a vibrating string and heat conduction in solids. 
Attempts to understand what these series meant and in what sense they solved these two 
problems in physics have contributed to the origin and growth of most of modern analysis. 
Among ideas and theories that owe their existence to questions arising out of the study of 
Fourier series are Cantor’s theory of infinite sets, the Riemann and the Lebesgue integrals 
and the summability of series. Even such a basic notion as that of a “function” was made 
rigorous because of these problems. A brief sketch of the history of Fourier series is given 
in this chapter. You could read it now and again at the end of this course when you will 
understand it better. 


1. The motion of a vibrating string 


It is a common experience that when an elastic string (such as a metal wire) tied at both 
ends is plucked or struck it begins vibrating. For simplicity, regard the string as a one- 
dimensional object occupying, when at rest, the interval 0 < x < 1 in the x-y plane. At 
time f = 0 the string is displaced to its initial position, keeping its end points fixed, i.e., 
the shape of the string now becomes like the graph of a function 


y=f(x) Ox<x<l, 
fO = f(1) =0. 
If the string is now released it starts vibrating. This is the model for a plucked string. We can 
also consider the struck string being described as: at time t = 0 each point x is imparted 


a velocity g(x) in the y-direction. This is called the initial velocity. Once again the string 
will vibrate. Let y = y(x, t) describe the graph of the displacement of the string at time t. 
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The motion is governed by the equations 


(i) Yur = a7 Vex. (the wave equation) 
(ii) v(O,t) = y(1,t)=0 forall?, (boundary conditions) 
(ili) v(x, 0) = f(x), y(x, 0) = g(x). (initial conditions) 


Here y, and vy denote the derivatives of y with respect to t and x. (See Section 5.3 for a 
derivation of the wave equation). What is the solution of this system? 
One can see that for each integer k., 


y(x,t) =sinkrx sinakrt (1) 
and 
y(x.t) =sinkzx cosakrt, (2) 


both satisfy (i). They also satisfy (ii). The first satisfies (iii) if f(x) = O and g(x) = 
akr sin krx. The second satisfies (iii) if f(x) = sin krx and g(x) = 0. 
Now note that any finite linear combination of functions like (1) and (2), i.e., a function 


y(x, 1) = >D sin kr x(æg cosakit + bk sinakrt), (3) 
k 


also satisfies (i) and (ii). It satisfies (iii) for certain choices of f and g. But if f and g are 
any arbitrary functions, then obviously a finite sum of the form (3) is not likely to satisfy 
the conditions (iii). Now notice that an infinite sum of the form (3) will also satisfy (i) 
and (1i) provided term by term differentiation of this series is permissible. So the questions 
arise: When is such differentiation permissible? If this series solution converges and can 
be differentiated, can we now make it satisfy conditions (iii) for any preassigned f and g? 
Are there any other solutions for our problem? 

Questions like this constitute the heart of analysis. It turns out that if f and g are 
sufficiently smooth, the solution we have outlined works, and is unique. (Functions in the 
vibrating string problem are piecewise C? and that is smooth enough.) Fourier series were 
introduced and developed in an attempt to answer such questions. And it is in the course of 
this development that such basic concepts of mathematics as set and function were made 
precise. 


2. J. D’Alembert 


The wave equation that describes the motion of a vibrating string was derived by J. 
D'Alembert in 1747. He gave a simple and elegant solution in the form 


v(x, t) = v(at +x) — v(at — x), 


which can be interpreted as a sum of two travelling waves, one moving to the left and 
the other to the right. (See Section 5.3, where we derive this solution via Fourier series. 
D’Alembert’s solution was simpler; but the method of separation of variables we use in 
these notes is more general.) 
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When we are studying the motion of a plucked string: y(x,0) = f(x), x(x, 0) = 0, 
there is one variable f in the problem and the solution also involves one variable v which 
can be determined from f. So D’ Alembert believed he had solved the problem completely. 


3. L. Euler 


At this time the word function had a very restricted meaning for mathematicians. A func- 
tion meant a formula like f(x) = x°, f(x) = sinx, or f(x) = x tan x? + 1747e*. The 
formula could be complicated but it had to be a single analytic expression. Something like 
f(x) = 3x? when 0 <x< L, and f(x) = (1 — x2) when I < x < 1 was not thought 
of as a function on [0, 1]. Euler thought that the initial position of the string need not al- 
ways be a “function.” The string could well be plucked to a shape as in Figure | and then 
released. Here different parts of the string are described by different functions. But Eu- 
ler claimed that the travelling wave solution of D’Alembert would still be valid; now the 
solution would involve several different functions instead of a single function v. 

In other words, at that time, function and graph meant two different things. Every func- 
tion can be represented by its graph but not every “graph” that could be drawn was the 
graph of a function. Euler's point was that the initial displacement of the string could be 
any graph and the travelling wave solution should work here also, the two waves them- 
selves being “graphs” now. This “physical” reasoning was rejected by D’Alembert: his 
“analytical” argument worked only for functions. 


| e 


FIGURE 1 
Plucked String 


4. D. Bernoulli 


In 1755, Daniel Bernoulli gave another solution for the problem in terms of standing waves. 
This is best understood by considering the solution 


y(x,t) =sinkzx cosakrt. 


When k = 1, the points x = 0 and x = 1, i.e., the two end points of the string, remain 
fixed at all times, and all other points move, the motion of any point being given as a 
cosine function of time. When k = 2 the points x = 0, x = | and also the point x = 1/2 
remain fixed at all times: the rest of the points all move; at any fixed time the string has 
the shape of a sine wave; and the motion of any point is given by a cosine function of 
time. The point x = 1/2 is called a node. For an arbitrary k > 1, the end points and the 
points 1/k,2/k,....(k — 1)/k on the string remain fixed while all other points move as 
described. These are called “standing waves”; the (interior) fixed points are called nodes 
and the motion for k = 1, 2,... is called the first harmonic, the second harmonic and so 
on. Bernoulli asserted that every solution to the problem of the plucked string (y(x. 0) = 
f(x), ¥r(x, 0) = 0) is a sum of these harmonics, and the sum could be infinite. 
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Euler strongly objected to Bernoulli’s claim. His objections were on two grounds. First 
of all, Bernoulli's claim would imply that any function f(x) could be represented as 


f(x) = > a, sin krx, (4) 


because at time ¢ = 0 the initial position could be any f(x). However, the right-hand side 
of (4) is a periodic function, whereas the left-hand side is completely arbitrary; further the 
right-hand side is an odd function of x whereas the left-hand side is completely arbitrary. 
Second, this would not, in any case, be a general solution to the problem. The right-hand 
side of (4) is an analytic formula, even though an infinite series, hence is a function. How- 
ever, as he had pointed out earlier in connection with D’Alembert’s solution, the initial 
position of the string could be any graph but not necessarily a function. So, Euler believed 
that D’Alembert’s travelling wave solution was applicable to the general case of the ini- 
tial position being a graph—which D`Alembert himself did not believe—but Bernoulli's 
solution would be applicable only to functions and to very restricted ones. 

Bernoulli did not contest Euler’s point about functions and graphs. However, he insisted 
that his solution was valid for all functions. His answer to Euler’s first objection was that 
the series (4) involved infinitely many coefficients œg and by choosing them properly one 
could make the series take the value f(x) for infinitely many x. Of course, now we know 
that if two functions f and g are equal at infinitely many points, then they need not be 
equal at all points. However, at that time the nature of infinity and of a function was still 
not clearly understood and so this argument sounded plausible. Euler did not accept it, but 
for different reasons. 

The series (4) is now known as a Fourier series and the coefficients œg are called the 
Fourier coefficients of f. Now we know that not every continuous function can be written 
in this form, but still Bernoulli was almost right, as we will see. Assuming that f can be 
represented as (4) and that the series can be integrated term by term, the coefficients a; are 
easily seen to be 


l 
a = Al F(x) sinkzx dx. (5) 
0 


Euler derived this formula by a complicated argument and then noticed it was an easy 
consequence of the orthogonality relations 


l 
| sinkzx sinmaxdx =Q. km. (6) 
0 


5. J. Fourier 


In 1804, Joseph Fourier began his studies of the conduction of heat in solids and in three 
remarkably productive years discovered the basic equations of heat conduction. developed 
new methods to solve them, used his methods to analyse several practical problems and 
supplied experimental evidence to support his theory. His work was described in his book 
The Analytical Theory of Heat, one of the most important books in the history of physics. 

Let us describe one of the simplest situations to which Fourier’s analysis can be applied. 
Consider a 2-dimensional disk, say the unit disk in the plane. Suppose the temperature at 


A HISTORY OF FOURIER SERIES 9 


each point of the boundary of the disk is known. Can we then find the temperature at any 
point inside the disk? At steady state the temperature u(r, 0) at a point (r, 6) obeys the 
equation 


(i) (rur), + l/r ugg = 0. 


This is called the Laplace equation in polar form. (See Section 1.1 for the derivation of 
this equation from basic principles.) We are given the temperatures at the boundary, i.e., 
we know 


(ii) u(1,0) = f(@), 


where f is a given continuous function. The problem is to find u(r, @) for all (r, 8). This is 
the same kind of problem as we considered earlier for the vibrations of a string. Using an 
analysis very much like that of Bernoulli, Fourier observed that any finite sum 


N 
u(r, @) = > Agr tlein8 


n=—N 


is a solution of (i). Of course, such a sum will not satisfy the boundary condition (ii) unless 
f is of a special type. Fourier asserted that an infinite sum 


[o,e] 
u(r, 0) = 5 Anr”! et"? 


naxx 


is also a solution of (i), and further by choosing A, properly it can be made to satisfy the 
boundary condition (ii). In other words we can write 


f@)= $ Ane”? (7) 


nS xX 


when f is any continuous function. 
So far, this is parallel to Bernoulli’s analysis of the vibrating string. But Fourier went 
a step further and claimed that his method will work not only for f given by a single 
analytical formula but for f given by any graph. In other words, now there was to be no 
distinction between a function and a graph. Indeed, if Fourier’s claim was valid, then every 
graph would also have a formula, namely the series associated with it. 
Fourier, like Euler, calculated the coefficients A,, occurring in (7), by a laborious (and 
wrong) method. These are given by 
1 f7 ; 
An = — f(0je™™?do. (8) 


2n Jan 


The series (7) is now also called a Fourier series and the coefficients (8) the Fourier co- 
efficients of f. Fourier noticed that the coefficients A, are meaningful whenever f is a 
graph bounding a definite area (integrable in present day terminology). So he claimed his 
solution was valid for all such f. 
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Fourier’s theory was criticised by Laplace and Lagrange, among others. However they 
recognised the importance of his work and awarded him a major prize. 
Since et”? = cos n0 + i sin nê. the series (8) can be rearranged and written as 


[oe] 
f@= x + X (an cosnô + bn sin nð). (9) 


n=l 


This too is called the Fourier series for f. 

Now, what about Euler’s two objections to Bernoulli’s solution? (Euler died in 1783 
and was not there to react to Fourier’s work.) How could an arbitrary function be a sum 
of periodic functions? The way out of this difficulty is astonishingly simple. The given 
function is defined on some bounded interval, say [0, 1] or [0, 77], where it represents some 
physical quantity of interest to us, like the displacement of a string. We can extend it outside 
this interval and make the extension periodic, and either odd or even. For example, if 
f(x) =x, 0 < x < 1, isthe function given to us, we can define an extension of it by putting 
f(x) = —x,—1 < x < 0, and then further extending it by putting f(x + 2k) = f(x), 
—| <x < 1,k € Z. This defines an even function of period 2. Its graph is Shown in 
Figure 2. 


cA, Tage: — 2 Tal 0 I 2 3 4 
FIGURE 2 


Even periodic extension of f 


We could also have extended f from its original definition f(x) = x,0 < x < 1, by 
putting f(x) = x,—1 < x < 0 and then extending it further by putting f(x + 2k) = 
f(x), —-1 < x < 1, as before. Now we get an odd function of period 2: the graph of this 
function is shown in Figure 3. The Fourier series in the first case is 


l 4 
f(x) = = — — cosmx — cos 37x —-:: 
2 xt 


2 


FIGURE 3 
Odd periodic extension of f 
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and in the second case it is 


2 2 2 
f(x) = — sinzx — — sin 2rx + — sin3mx —--- 

x 2yr 1 
(These expansions, and several others are derived in Section 3.3). In the interval [0, 1) both 
series converge to the same limit. Notice that the terms of one series are all even functions 
and of the other are all odd. Of course if a function is thought of as a formula, then these 
extensions are not functions. Fourier’s idea of admitting functions which are identical on 
some interval but different elsewhere made it possible to apply his theory to a wide variety 
of situations. It also led to a critical examination of the notion of a function itself. 

As Fourier observed, the coefficients A,, in (8) made sense for all functions for which 
the integral is finite. He believed that the series (7) would equal f for all such f at all 8. 
Here he was not right, but in a nontrivial sense. For all good (piecewise smooth) functions 
which occurred in his problems he was right. 


6. P. Dirichlet 


Fourier did not state or prove any statement about Fourier series that would be judged to 
be “correct” in a mathematics examination today. It was Dirichlet who took up Fourier’s 
work and made it into rigorous mathematics. In the process he laid firm foundations for 
modern analysis. 

First of all it was necessary to have a clear definition of a function. Dirichlet gave the 
definition which we learn now in our courses: a function is a rule which assigns a definite 
value f(x) to any x in a certain set of points. Notice now that a function need no longer 
be a “graph,” let alone a formula. In fact Dirichlet in 1828 gave an example that Fourier 
could not have imagined. This is the characteristic function of the set of rational numbers: 
f(x) = lifx is rational and f(x) = Oif x is irrational. This function cannot be represented 
by any “graph.” So now the subject of analysis was no longer a part of geometry. Notice 
also that this function does not “bound any area,” so its Fourier coefficients cannot be 
calculated by Fourier’s methods. 

However, for all functions f that can be “drawn.” i.e.. for piecewise smooth functions f. 
Dirichlet proved that the Fourier series of f converges to f(x) at every point x where f is 
continuous, and to the average value T f(x+)+ f(x_)) if f has a jump at x. Further, if f 
is smooth on an interval [a, b]. then its Fourier series converges uniformly to f on [a, b]. 
This was the first major convergence result for Fourier series. A later example is C. Jordan's 
theorem that says that continuous functions of bounded variation have convergent Fourier 
series. Dirichlet’s theorem was a forerunner of several others giving sufficient conditions 
for a function to have a convergent Fourier series. (Some of these theorems are proved in 
Chapter 2. Section 3.) 


7. B. Riemann 


To handle functions that are not graphs, i-e., those that have more than finitely many turns 
and jumps, one would necd to generalise the notion of an integral beyond the intuitive idea 
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of the “area under a curve.” Only then can we hope to calculate the Fourier coefficients of a 
function with infinitely many discontinuities. Riemann developed his theory of integration, 
which could handle such functions—that is the integral that we learn first now. 

Using this integral Riemann gave an example of a function that does not satisfy Dirich- 
let's or Jordan's condition but has a pointwise convergent Fourier series. Riemann initiated 
the study of trigonometric series that need not be Fourier series of any function. 


8. P. du Bois-Reymond 


Dirichlet believed (and thought that he would soon prove) that the Fourier series of every 
continuous function, and perhaps of every Riemann integrable function, converges at every 
point. This belief came to be shared by other prominent mathematicians like Riemann, 
Weierstrass and Dedekind. In 1876, however, Du Bois-Reymond proved them wrong by 
constructing an example of a continuous function whose Fourier series is divergent at one 
point. 

You might have come across the Weierstrass construction of an example of a continu- 
ous function which is not differentiable at any point. The function is obtained by succes- 
sively constructing worse and worse functions. Du Bois-Reymond’s example is a similar 
construction. This method is called the principle of condensation of singularities. (The 
construction of the example and the general method are described in Chapter 2, Section 5.) 


9. G. Cantor 


Cantor's theory of sets and infinite numbers is now the basis for all analysis. This theory 
too owes its existence, at least in part, to Cantor’s interest in Fourier series. He observed 
that changing a function f at a few points does not change its Fourier coefficients. So the 
behaviour of f at a few points does not matter for Fourier analysis. How many points can 
be ignored in this way and what kind of sets do they constitute? This problem led Cantor 
to his study of infinite sets and cardinal numbers. 


10. L. Fejér 


Consider the series }* x, where x, = (—1)",n > 0. The partial sums s, of this series are 
alternately | and 0. So the series does not converge. However, its divergence is different 
in character from that of the series ` n or )°1/n. In these latter cases the partial sums 
diverge to oo, whereas in the former case the partial sums oscillate between 1 and 0 and 
hence on an average take the value ł/2. We say that a series >> Xn is (C, 1) summable 
or Cesaro summable if the sequence on = 1 (59 + S| + +++ + 5,-1). formed by taking 
the averages of the first n partial sums of the series, converges. Every convergent series is 
(C, 1) summable; a series may be (C, 1) summable but not convergent, for example this is 
the case when x, = (—1)". 

In 1904, Fejér proved that the Fourier series of every continuous function is (C, 1) 
summable and, in this new sense, converges uniformly to the function. This theorem is ex- 
tremely useful and gave an impetus to the study of summability of series. (Fejér’s Theorem 
is proved in Chapter 2, Section 2.) 
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11. H. Lebesgue 


It had already been noted, by Cantor among others, that changing a function at “a few” 
points does not alter its Fourier series, because the value of the integral (8) defining the 
Fourier coefficients is not affected. So it is not proper to ask whether the sum of the Fourier 
series of f is equal to f at every point; rather we should ask whether the two are equal 
everywhere except on those sets that are irrelevant in integration. 

This problem led to a critical examination of the Riemann integral. Just as Riemann was 
motivated by problems in Fourier series to define a new concept of integration, the same 
motivation led Lebesgue to define a new integral that is more flexible. The notions of sets 
of measure zero and almost everywhere equality of functions now changed the meaning of 
function even more. We regard two functions f and g as identical if they differ only on a 
set of measure zero. Thus, Dirichlet’s function (the characteristic function of the rationals) 
is equal to 0 “almost everywhere.” So, from a formula to a graph to a rule, a function now 
became an equivalence class. 

The Lebesgue integral is indispensable in analysis. Many basic spaces of functions are 
defincd using this integral. We will talk about the L „ spaces 


t= ff: fife <o}, l<p<œ, 


in particular. 


12. A.N. Kolmogorov 


Before Du Bois-Reymond’s example in 1876, mathematicians believed that the Fourier 
series of a continuous function will converge at every point. Since they had failed to prove 
this, the example made them think that perhaps the very opposite might be true—that there 
might exist a continuous function whose Fourier series diverges at every point. 

In 1926 Kolmogorov proved something less but still very striking. He proved that there 
exists a Lebesgue integrable function defined on [—x, 7}, i.e., a function in the space 
L\({—2. 27]), whose Fourier series diverges at every point. 


13. L. Carleson 


The function constructed by Kolmogorov is not continuous, not even Riemann integrable. 
However, after his example was published it was expected that sooner or later a continuous 
function with an everywhere divergent Fourier series would be discovered. There was a 
surprise once again. In 1966 Carleson proved that if f is in the space L2([—Z, 77]), then its 
Fourier series converges to f at almost all points. In particular, this is true for continuous 
functions. So Fourier had been almost right! 

Carleson’s theorem is much harder to prove than any of the other results that we have 
mentioned. This whole investigation, which had occupied some of the very best mathe- 
maticians over two centuries, was nicely rounded off when in 1967, R.A. Hunt proved that 
the Fourier series of every function in Lp, 1 < p < œ, converges almost everywhere; and 
in the converse direction Y. Katznelson and J.P. Kahane proved in 1966 that given a set E 
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of Lebesgue measure 0 in [—z, 7], there exists a continuous function whose Fourier series 
diverges on E. 


14. The L; theory and Hilbert spaces 


We have already spoken of the space L2, and earlier of orthogonality of trigonometric 
functions. The space L2 is an example of a Hilbert space: in such spaces an abstract no- 
tion of distance and of orthogonality are defined. The functions e,(x) = e'""/ J2n,n = 
0, +1, +2, .... constitute an orthonormal basis in the space L2([—7, 77]). So the Fourier 
series of f is now just an expansion of f with respect to this basis: f(x) = yo Ann (Xx): 
just as in the three-dimensional space R3, a vector can be written as a sum of its compo- 
nents in the three directions. The infinite expansion now is convergent in the metric of the 
space La, i.e., 


4 


x N F 
im |S o- Yo aanw dx} =o. 


=n n=—N 


This notion of convergence is different from that of convergence at every point, or at almost 
every point; but, in a sense, it is more natural because of the interpretation of the Fourier 
series as an orthogonal expansion. (We study this in Chapter 4.) 


15. Some modern developments—l 


Onc of the basic theorems in functional analysis says that the Hilbert spaces La ([-x, J) 
and l2 are isomorphic. This theorem, called the Riesz—Fischer Theorem, is proved using 
Fourier series. It is taken as the starting point of J. von Neumann’s “transformation the- 
ory” which he developed to show the equivalence of the two basic approaches to quantum 
mechanics called matrix mechanics and wave mechanics. 

Another “transformation theory” achieving the same objective was developed by P.A.M. 
Dirac. In this theory a crucial role is played by the “6-function.” This has some unusual 
properties not consistent with classical analysis. (In von Neumann’s book Mathematical 
Foundations of Quantum Mechanics the 6-function is described as “‘fiction.”) Among other 
things the 5-function satisfies the properties (x) = 6(—x), (x) = 0 for all x except for 
x = Oand f ô(x) = 1. Clearly now the integral could neither mean the area under a graph 
nor the Riemann integral nor the Lebesgue integral. The study of such objects, which are 
now called generalised functions or distributions. is a major branch of analysis developed 
by S.L. Sobolev and L. Schwartz. In some sense, spaces of such functions have become 
the most natural domain for Fourier analysis. 


16. Some modern developments —l 


We have talked only of Fourier series. A related object is the Fourier integral introduced 
by Fourier to study heat conduction in an infinite rod. This is the integral defined as 
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™~ 
f = J fixye™® dx, reR 
-%0 


and is called the Fourier transform of the function f. Notice the similarity between this and 
the Fourier coefficients where the variable ¢ is replaced by the integer n, and the domain of 
integration is [—77, 7] instead of (—00. 00). 

On the one hand this object has been used in such areas as heat conduction, optics, signal 
processing, and probability. On the other hand the subject has been made more abstract 
in a branch of mathematics called harmonic analysis. Integers and the interval [—z. 7) 
identified with the unit circle both form groups. Fourier series constitute harmonic analysis 
on these groups. The Fourier transform belongs to harmonic analysis on the group R. A 
very similar analysis can be done on several other groups. 

Major contributions to the “applied” branch were made by N. Wiener who developed 
what he called “generalised harmonic analysis.” “Pure™ harmonic analysis has developed 
into one of the central areas in mathematics. Some of the major figures in its development 
were E. Cartan, H. Weyl and Harish-Chandra. And this brings us to our final highlight. 


17. Pure and applied mathematics 


Fourier series were invented by Fourier who was studying a physical problem. It is no won- 
der then that they have applications. Of course not all creatures of “applied mathematics 
have applications in as wide an area as Fouricr series do. As this account shows, attempts 
to understand the behaviour of these series also laid down the foundations of rigorous anal- 
ysis. Questions like uniform convergence, Cesaro summability and subjects like transfinite 
cardinals and Lebesgue measure are thought of as “pure” mathematics. Their history too is 
related to Fourier series. 

Among the purest branches of mathematics is number theory—and surely it is a subject 
quite independent of Fourier series. Yet Hermann Weyl used Fejér’s convergence theorem 
for Fourier series to prove a beautiful theorem in number theory, called the Weyl Equidis- 
tribution Theorem. Every real number x can be written as x = [x] + X, where [x] is the 
integral part of x and is an integer, x is the fractional part of x and is a real number lying 
in the interval [0, 1). Weyl’s theorem says that if x is an irrational number then, for large N, 
the fractional parts ¥, (2x)~...., (Nx)~ are scattered uniformly over (0, 1). (This theorem 
is proved in Chapter 5. Section 1.) 

One of the areas where Fourier series and transforms have major applications, is crystal- 
lography. In 1985 the Nobel Prize in Chemistry was given to H. A. Hauptman and J. Karle 
who developed a new method for calculating some crystallographic constants from their 
Fourier coefficients, which can be inferred from measurements. Two crucial ingredients 
of their analysis are Weyl’s equidistribution theorem and theorems of Toeplitz on Fourier 
series of nonnegative functions. 

Fast computers and computations have changed human life in the last few decades. One 
of the major tools in these computations is the Fast Fourier Transform introduced in 1965 
by J. Cooley and J. Tukey in a short paper titled An algorithm for the machine calculation 
of complex Fourier series. Their idea reduced the number of arithmetic operations required 
in calculating a discretised version of the Fourier transform from O(N*) to O(N log N). 
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This went a long way in making many large calculations a practical job. (Note that if 
N = 10, then N? = 10° but N log N is approximately 7000.) In 1993 it was estimated 
that nearly half of all supercomputer central processing unit time was used in calculating 
the Fast Fourier Transform—used even for ordinary multiplication of large numbers. 

Another major advance in the last few years is the introduction of wavelets. Here func- 
tions are expanded not in terms of Fourier series, but in terms of some other orthonormal 
bases that are suited to faster computations. This has led to new algorithms for signal pro- 
cessing and for numerical solutions of equations. 

If conduction of heat is related to the theory of numbers, and if theorems about numbers 
are found useful in chemistry, this story has a moral. The boundary between deep and 
shallow may be sharper than that between pure and applied. 


In this chapter we derive the mathematical equations that describe the phenomenon of heat 
flow in a thin plate. We explain how, and in what sense, these equations are solved using 
Fourier Series. Our analysis leads to several questions. Some of these are answered in 
Chapters 1 and 2. 


1.1 The Laplace equation in two dimensions 


The equation 


3u 3u 
x2 + ay? = 0 (1.1) 
is called the 2-variable Laplace equation. Here u(x, y) is a function on R? which is of 
class C?, i.e., u has continuous derivatives up to the second order. 

This equation describes natural phenomena such as steady flow of heat in two dimen- 
sions. To understand this imagine a thin plate of some material. We can view this as a 
section of the plane with some boundary. If different parts of the plate are at different tem- 
peratures, then heat flows from a point at higher temperature to one at lower temperature 
according to Newton's law of cooling. This says that if I is a curve in the plane, then the 
rate at which heat flows across [l is equal to k fr (du/an)dy, where (x, y) is the tem- 
perature at the point (x, y) of the plate, d/dn denotes the derivative of u with respect to 
arc length along any curve normal to T and k is a constant called the thermal conductivity 
of the material of which the plate is made. (This is an experimental fact which describes 
the situation very accurately for moderate temperature gradients. We will accept this as a 
postulate.) 

Now consider a small rectangular section of the plate 


{(x, y): x0 <x < x1, Y0 < y < yı}. 


13 
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If the plate is in thermal equilibrium, i.e., there is a steady state in which there is no net heat 
flow into this small section of the plate or out of it, then calculating the heat flow across 
the four boundaries of the above section according to Newton's law and equating it to 0 
(steady state) we get 


y (ðu ðu a {= ou 
— (x1, ¥) — — (x0, ¥)} dy + — (xX. ¥1) — cx. ya) a = 0. 
f ja Cy) T »| ? Í oy dy 


The negative signs here correspond to our understanding that if heat is flowing into the 
rectangle from one side, then it is flowing out of it from the opposite side. Divide this 
equation by xı — xo and then let xı — xo. One gets 


7i 3u ou ou 
— (xo, ¥) dy + — (xo, y1) — — (x0, Yo) = 9. 
f ar30 y) d: gy Or) TA 0» Yo) 
Now divide by yı — yo and let yı —> yo. This gives 

2 2 


onu On-u 
—> (x0. Yo) + 5 (Xo, Yo) = 0. 
Ox- 3y- 


This is the Laplace Equation (1.1) and as we have seen above it describes the phenomenon 
of steady state heat conduction in two dimensions. 
We will find it more convenient to use polar coordinates. In these coordinates (1.1) can 
be transformed to 
u 13u 1 3?u 
ar rar t aa 


for r Æ 0. where as usual (r, 0) are the polar coordinates of a point in the plane. 


Exercise 1.1.1. Derive (1.2) from (1.1) by a change of variables. Hint: Use the relations 


Ou ou l Ou 
Cie 0— — - şinĝ — 
ae Oe a8" 
ou ou l ou 
— =sind— + — need 
ay sin a + 2 cos@ 30 


which can be derived from the basic relations x = rcos@, y =r sin@. 


Exercise 1.1.2. Derive (1.2) directly from Newton’s law. Hints: Instead of the rectangular 
element that was used earlier consider now the element 


(7,8): 19 <r <ri, 6o <8 <0}. 


To calculate the rate of heat flow across the side @ = @9. choose as curves normal to it the 
circular curves r = constant. Then note that the normal derivative with respect to the arc 
length along these curves is 


ou . u(r, 8o +40) — u(r, 8o) l] ou 
RSA FR cat cs a SY 
on 56-0 ré6@ r 00 oo: 


Add the contributions from the four sides of the element and proceed as before. 
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Now consider a circular disk 
D=({(r,0):0<r<l.—-nx <0 <x}. 


As usual the points (r, —zr ) and (r, 7) are considered to be identical. At steady state the 
temperature u(r, 0) for all points 0 < r < 1 on D satisfies equation (1.2). Extend this to 
the origin by the natural condition 


u(r, @) is continuous on D. (1.3) 
We must also have 
u(r, 8) = u(r, @ + 277). (1.4) 
By a boundary condition we mean a condition of the type 
u(1,@) = f(@), (1.5) 


where f is a given function defined on [—z, zr] that is continuous and for which f(—zr) = 
f(x). 

The problem of finding a function u satisfying (1.2)—(1.5) is called a Dirichlet problem. 
This is a typical instance of a boundary value problem in physics. In the present situation 
this is: the temperature at the boundary of D is known to us and is given by (1.5): assuming 
that the temperature function inside D satisfies (1.2)—(1.4) can we find it? In the remaining 
part of this chapter we shall answer this question. 


Exercise 1.1.3. Note that every constant function satisfies (1.2)-(1.4). Show that the func- 
tion u(r, 0) = logr satisfies (1.2) and (1.4) but not (1.3). 


1.2 Solutions of the Laplace equation 


Let us first derive solutions of two ordinary differential equations. 
The first is the second order differential equation with constant coefficients: 


y” tay’ + by =0. (1.6) 


The familiar method of solving this is the following. If L denotes the differential operator 


9 


| eee We ea 
dx2 dx 


then (1.6) can be written as 
L(y) = 0. (1.7) 
Note that 


L(e“*) = (a? +aa+bjye™, 
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and hence y = e® is a solution of (1.7) provided @ is a root of the polynomial equation 
pla) =a"? +aa+b=0. (1.8) 


This is called the characteristic equation associated with the differential equation (1.6). If 


this quadratic equation has two distinct roots a, and a, then the solutions e'* and e% 
of (1.6) are linearly independent and hence their linear combination 
y= cet + coe (1.9) 


gives the general solution of (1.6). If (1.8) has a double root œo, then one solution of (1.6) 
is e*°*. In this case p(ag) = p’ (ao) = 0 and one can see that 


L(xe%*) = p'(ag)e* + p(ag)xe™ = 0. 


So, in this case xe®* is another solution and the most gencral solution of (1.6) is of the 
type 


y = ce + eare . (1.10) 
The second equation that will arise in our analysis is the equation 
x?y" + axy’ + by =0, x>0 (1.11) 


which is called an equation of Cauchy type, in which the coefficient of y" is x”. Proceed- 
ing as earlier, let 


d? d 
Lar ba Pb. 
Agee dx ii 
and note 
L(x*) = p(a)x®, 
where, 


pla) =a(a —1)+aa+b. 
Hence y = x“ is a solution of (1.11) provided « is a solution of the characteristic equation 
pla) = 0. 
So, if this equation has two distinct roots a and a2, then the general solution of (1.11) is 
y = cx + cox (1.12) 


In case p(œ) = 0 has a double root œo, then one can check that x and x% log x are two 
linearly independent solutions of (1.11) and hence the general solution, in this case, is 


y = Cix + Cox™ log x. (1.13) 
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Now the Laplace equation can be solved by a standard device—the separation method 
which can (sometimes) reduce a partial differential equation to ordinary differential equa- 
tions. This proceeds as follows. Let us assume, tentatively, that (1.2) has a solution of the 
form 


u(r,0) = R(r)F (0), (1.14) 
where R and F are functions of r and 8 alone, respectively. Then (1.2) becomes 
r°R"F +rR'F+ RF" =0. 


This is a mixture of two ordinary differential equations, which can be “separated” if we 
divide by RF and then rearrange terms as 


Notice that now one side does not depend upon @ and the other side docs not depend 
upon r. Hence the quantity on either side of this equation must be a constant. Denoting this 
constant by c, we get two equations 


F"+cF =0, (1.15) 
rR" +rR'—cR=O, (1.16) 


which are ordinary differential equations of the type (1.6) and (1.11), respectively. 


Exercise 1.2.1. Show that the equations (1.15) and (1.16) have the following solutions: 
(i) if c > 0, then 
F(0) = Ac'V + Beye, 
R(r) = ar Y€ + br“; 
(ii) if c = 0. then 
F(0) = A + B9, 
R(r) =a +blogr; 
(ili) if c < 0, then 
F(0) = Aev~© + Bey, 
R(r) = ari V~ + br iv-e, 
Here A, B, a, b are constants. 
(Though our function u(r, @) is real, we will find it convenient to use complex quantities. 


If r is positive and @ is any real number, then we have ri = eielogr = cos(alogr) + 
i sin(@ logr’)). 
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In each of the three cases above u = RF gives a solution of the Laplace equation ( 1.2). 
However, our other conditions rule out some of these solutions. The condition (1.4) says 
that u(r. 6) is a periodic function of @ with period 27. The function « = RF in case (iii) 
of Exercise 1.2.1 fails to meet this requirement. In case (ii) the function F (@) is periodic 
only when B = 0, and the function R(r) is bounded only when b = 0. Thus the only 
admissible solution in case (ii) is u = Aa. In case (i) the condition (1.4) is satisfied iff 

a eee With these values of c, R is bounded at the origin if b = 0. So the 
solution in Case (i) has the form u = ar" (Ae"? + Be7i®?) n =1.2,.... 

Thus, we have shown that all solutions of (1.2)-(1.4) that are of the form (1.14) are 


given by 
unr, 6) = ar" (Ae? + Be7i"®), n=0,1,2,... 


where a. A. B are constants. Now notice that (finite) linear combinations of solutions of 
(1.2)-(1.4) are again solutions. So the sums 


N . 
` Agr tlein® | (1.17) 
n=—-N 


where A,, are constants all satisfy (1.2)-(1.4) for N = 1,2,...- 
The constants A, will be determined from the boundary condition (1.5). However it is 
clear that we cannot expect an arbitrary function f to be equal to a sum Ypy Ane’””. 
One may now wonder whether an infinite sum 


x . 
> Apr”lei”® (1.18) 


n=- 


is also a solution of (1.2)-(1.4). If so, then can the boundary condition (1.5) be satisfied by 
choosing the coefficients A, properly, i.e., do we have 


mo 
f(@)=u(1.0)= > Ar. (1.19) 


n=O 


Fourier asserted that this is indeed so for (virtually) every function f. He was not quite 
right. However, his analysis of this problem led to several developments in mathematics 
which we mentioned at the beginning. 

To sum up: our analysis till (1.17) has been quite rigorous. Now we would like to answer 
the following questions: 


1. For what functions f can we choose constants A,, So that the equation (1.19) 1s satisfied? 
If this equation is not satisfied in the usual sense of “pointwise convergence” is it true 
in some other sense? How are the coefficients A, determined from f? 


Io 


If A, are chosen properly then is (1.18) indeed a solution of the Dirichlet problem? 


Exercise 1.2.2. Some mystery may be taken out of the above problem if you use your 
knowledge of complex analysis. Any function (x, y) satisfying (1.1) is called a harmonic 
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function. A function that is harmonic in the region D is the real part of a complex analytic 
function, i.e., there exists an analytic function g(z) on D such that g = u + iv. Every such 
g has a power series expansion } -72 ganz” convergent in the interior of D. The coefficients 
a, can be determined from g by Cauchy`s integral formula. Recall that this power series 
does not converge at all points on the boundary of D. Usce these facts to answer questions 
about Fourier series raised above. 


1.3 The complete solution of the Laplace equation 


We denote by T the boundary of the disk D. We can identify T with the interval (—z, 7], 
where the points —z and x are regarded as the same. By a function on T we mean a 
function on [—z, 7] such that f(—7) = f(z). Such a function can also be thought of as 
representing a periodic function on R with period 27. So, we will use the terms “function 
on T” and “periodic function on R with period 27” interchangeably. 

Let f be a continuous function on T. We want to know whether it is possible to write f 
as an infinite series 


(0.6) 
f(0)= $, An (1.20) 
n=-OO 


for some coefficients A, depending on f. Suppose this is possible. Then what should A, 
be? Recall that 


f Aime jo = | 0 ifmÆ0, 
-n 


2n ifm=0. 


So, if we do have an expansion like (1.20) and if further this series could be integrated 
term by term, then we must have 


I: 7 
An = — f(0)je™? dé. (1.21) 
2n Jx 


So given a continuous, or more generally, an integrable function f on T let us define 
for each integer n, 


å l x : 
fn) = = f(@ye7"? d0. (1.22) 


-0 


Each f (n) is well defined. This is called the nth Fourier coefficient of f. The series 
a A a 
X fime"? (1.23) 
n=—00 


is called the Fourier series of f At this moment we do not know whether this series 
converges, and if it converges whether at each point @ it equals f (0). 

Now let us return to the Dirichlet problem. Consider the series (1.18) where A, are 
given by (1.21); we get a series 
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ise) Ww l l 

S) —rl e6- Fit) dt. (1.24) 
2x 

-oQ Yn 


Now forr < | the series } r'”lei”®-) converges uniformly in t. (Use the M-test). 
Hence the sum and the integral in (1.24) can be interchanged. Also, using the identities 


Me 
“ 
z= 
I 
E 
| — 
~ 


n=0 
—l x 
x 
À l x Y= 
]-—.x 
n=—-OO n=l 


both valid when |x| < 1, one obtains 


29 f l-) 
D a = ———— for r<l. 
~ l — 2r cos(0 — t) +r- 


Thus the series (1.24) converges for all r and 0, when 0 < r < l| and -n < 0 <x. 
Call the sum of this series u(r, 0); we have 


1 7 l-r? 
"0) = — — f (t) dt. 1.25 
uUe on I. 1 — 2r cos(@ — ya ) S 


This is called the Poisson integral of f. The function 


l-r? 


P(r.0) = z0 <r<l. (1.26) 


27 l — 2r cos +r- 
is called the Poisson kernel. 
A simple calculation shows that 


3? a F 
pi + ra. + i) (r” cosn@) = 0. for all n. 


Since forr < 1 the series 07, rle", being absolutely and uniformly convergent, can 
be differentiated term by term, this shows that u(r, @) as defined above is a solution of the 
Laplace equation. Thus u(r, @) defined by (1.25) satisfies (1.2), (1.3) and (1.4). We will 
show that it also “satisfies” the boundary condition (1.5) in the sense that u(r, @) tends to 
f(@) uniformly as r > 1. 

Let f and g be two periodic functions on R with period 27. If f and g are continuous, 
we define their convolution f * g by 


n 
(f * g)(x) = f(x —tye(t)dt. 


~n 
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More generally, if f and g are two integrable functions, then 


n 
J If —Nginldt < o0 
-70 

for almost all x. For these x we define (f x g)(x) = fc. f(x —t)g(t) dt. 

It is easy to see that f xg =g x f. 

Convolution is thus a commutative binary operation on the space of continuous periodic 
functions. Show that this operation is associative. 

Does there exist an “identity” element for this operation? There is no continuous func- 
tion g such that g x f = f forall f. (See Exercise 4.2.5.) However, there is a modified 
notion of “approximate identity” in this context which is useful. We can find a family of 
functions Qn such that Q, x f converges to f uniformly on [—z, zr] for all continuous 
functions f. 

We call a sequence of functions Q, on [—7, 1] a Dirac sequence if 


(i) Qn(t) = 0. (1.27) 
(ii) Qn(—t) = Q,(t), (1.28) 


(ili) Q,(t)dt =1, (1.29) 


(iv) foreach e > 0 and ô > 0, there exists N such that for all n > N, 
-ő 


onodi | Qn(t)dt < €. (1.30) 
5 


-n 


You should ponder here a bit to see what these conditions mean. The first three conditions 
say that each Q, is positive, even, and normalised so that its integral is 1. The last condition 
says that as n becomes large the graph of Q, peaks more and more sharply at 0. 


Theorem 1.3.1. Let f be a continuous function on [—1,1] and let Qn be a Dirac se- 
quence. Then Qn * f converges to f uniformly on [—1, n] asn —> œ. 


Proof Let hy = Qn * f. Using (1.29) we have 
h- f= | fæ- fN) di. 


Let £ be any given positive real number. The function f is uniformly continuous on 
[—x., 7]. i.e., there exists a ô > 0 such that 


f(x —t)— f(x)| < = whenever |t| < ô. 


Let M = sup_,<yez | f (x)|- Using (1.30) we can choose N such that for alln > N, 


pee n A 
ondi | On(t)dt < IM: 


-70 
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Hence 
—ô a ; 
(i + ) f(x —t) — f(x) Qn (t) dt < 2M aoe 
Also, 
5 a 
J IS —t) — f(xX)[Qu(t) dt <| EOn(t)dt < È. 
=$ 2 
Hence 


lha) faol <e foralln > N. a 


Later on, you might study the theory of distributions (or generalised functions) where 
you will come across Dirac’s ô- function, which is not a function in the sense we understand 
it now, and which serves as an identity for the convolution operation. 

In the same way, we define a Dirac family as a family of functions Q,,0 < r < 1, 
where each Q, satisfies the conditions (1.27), (1.28) and (1.29) and further for each £ and 
ô > O, there exists ro such that for r > ro, 


—§ n 
onnar+ | Q,(t)dt < €. (1.31) 
5 


bagi 


In this case Q, * f converges to f uniformly as r — 1. 


Exercise 1.3.2. Show that the Poisson Kernel defined by (1.26) has the following proper- 
ties: 
(i) P(r.) = 0, 
(ii) P(r.) = P(r. —9), 
(iii) P(r, gy) is a monotonically decreasing function of ¢ in [0. 27], 
(iv) MAX_z<y<m P(r, y) = P(r.0) = (1 +r)/2x(1 — r), 
(Y) MiN_z<y<r Pp) = P(r. n) = (1 —r)/2n(1 +r). 
(vi) I" P(r.g)\dy = 1, 


(vii) for each £, ô > 0, there exists O < rg < 1 such that, for ro <r < l. we have 


—ő x 
J P(r. g)dp +f Pir, g)dg < €. 
ž 5 


m 


Hint: To prove (vii) procecd as follows. Since P(r, y) is an even function of y you need to 
prove k P(r. p)dp < €/2. Since P(r, p) is monotonically decreasing, 


l-r? 
max P(r. g) = ————————. 
S<y<n ? 7 l —2rcos6+r2 
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Now fora fixed 6 > 0, 


S 
: l-r- 

lim ————_———. = 0. 
rol 1—2rcosé4+r- 


Use this to choose the ro that is required. 


FIGURE 1 
The Poisson kernel 


Theorem 1.3.3. (Poisson’s Theorem) Let f be a continuous function on T and let u(r. @) 
be defined by (1.25). Then asr —> 1,u(r,@) —> f(@) uniformly. 


Proof For0 <r < 1, let P,(g) = P(r, p) denote the Poisson kernel. Then 
u(r. 0) = (P, * f)(@). 


The family P, is a Dirac family (by the preceding exercise). Use Theorem 1.3.1 now. W 


Let us sum up what we have achieved so far. We have shown that u(r, @) defined 
by (1.25) satisfies the conditions (1.2), (1.3) and (1.4) of the Dirichlet problem and fur- 
ther (for every continuous function f) it satisfies the boundary condition (1.5) in that 
lim,_. u(r, @) = f(@) and the convergence is uniform in 8. 

So we have found a solution to the Dirichlet problem. We will now show that the solu- 
tion is unique, i.e., if u(r, @) is another function that satisfies (1.2), (1.3) and (1.4) and if 
u(r. @) converges to f(@) uniformly as r — 1, then u(r, @) = u(r, 0). 


Exercise 1.3.4. Let f and g be continuous functions on 7. Show that if f (n) = g(n) for 
all integers n, then f = g. (Hint: Use Poisson’s Theorem). 
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Exercise 1.3.5. Let f be a continuous function on T. Suppose the Fourier series of f 
converges uniformly. Show that its limit must be f. (Hint: Calculate the Fourier coefficients 
of the limit function.) 


Warning: We have not proved that the Fourier series of a continuous function on T 
converges uniformly, or even pointwise, to f. In fact, this is false: there exists a continuous 
function whose Fourier series diverges on an uncountable set. However, we have shown 
that for each O < r < 1, the series °° _ r"! f(n)e!® converges and as r approaches | 


it converges uniformly to f. 


Exercise 1.3.6. Let f be acontinuous function on T and suppose the series $ pco | f (n)| 
converges. Show that the Fourier series of f converges to f uniformly on T. 

This gives a sufficient condition for the convergence of Fourier series. Much stronger 
results will be proved in Chapter 2. 


Theorem 1.3.7. (Uniqueness of the solution to Dirichlet’s problem) Let f be a contin- 
uous periodic function with period 21. Let u(r, 0) be a function that satisfies (1.2), (1.3) 
and (1.4) and let u(r,@) converge to f(@) uniformly as r — 1. Then u must be given 
by (1.25). 


Proof Fora fixedr < 1, let A,(r) denote the Fourier coefficients of u(r, 0), i-e., 


l u , 
An(r) = P u(r, Oye"? do. 


at Jon 


Differentiate with respect to r: 


l n . 
A, (r) = mak ure dé, 


= a 
n 
(rA (r) = — (ru,)re™®? dé 
an aa i 
l w] ; 
= Sar ~ wage" dé 
= S 


since u satisfies (1.2). Here u, and ug denote the derivatives of u with respect to r and @. 
Now integrate by parts and use (1.4) to get 


(AD = Ant). 


rAn(r) +rAl(r) —n2An(r) = 0. (1.32) 


Now this is exactly the Cauchy type differential equation which we have seen earlier 
as (1.11). For n Æ 0 its solution is 


An(r) = Car”! + Dar"! 


HEAT CONDUCTION AND FOURIER SERIES 25 


where C,, and D, are constants. Since 
|An(r)| < sup |u(r, @)| 
and u(r, 8) is bounded on D we must have 
An(r) = Cyr", n #0. 


The C,, are determined as follows: 


l m A 
Cyr”! = Apr) = F u(r, Oe"? dé. 


-= -N 


Letting r — | this gives 
1 f7 : R 
Cn = zl fye ™? do = fin),n £0. 
ont xn 


Thus A„ (r) = Fim! n Æ 0. For n = 0 the only bounded solution of (1.2) is 
Ao(r) = constant. 


Hence 
n 
J u(r, 0) d@ is independent of r. 
—7T 


So forallO <r < 1, 


a 


l lf? 
Ao(r) = Ay = T z u(r.8)d@ = ae 2 f (6) dé. 
We have shown that the Fourier coefficients of u(r.) are f (n)r"!. But these are also the 
Fourier coefficients of (1.25). So the theorem follows from Exercise 1.3.4. a 


Exercise 1.3.8. 


(i) Prove the “mean value property” of temperature: at steady state the temperature at 
the centre of a disk is the average of the temperature on the boundary. 
(ii) Prove the “maximum principle” and the “minimum principle”: at steady state the 
hottest and the coldest points on a disk are at the boundary. 
(iii) Can you relate these results to facts which you might have learnt in your Complex 
Analysis course? 


Exercise 1.3.9. Use Poisson’s Theorem to prove the Weierstrass Approximation Theorem 
in the following form: let f (0) be a continuous periodic function of period 2x, then f is a 
uniform limit of “trigonometric polynomials,” i.e., finite sums of the form y nine” 


Exercise 1.3.10. Let f and g be two integrable functions on [—x, 7]. Show that their 
convolution f * g is also an integrable function. If either f or g is continuous, show that 
f * g is continuous; and if either f or g is C', show that f g is also C! 
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Exercise 1.3.11. (An extension of Theorem 1.3.1 to integrable functions). Let f be inte- 
grable on [—7, 1] and let Qn, be a Dirac sequence. Show that 
(i) (On x f)(x) 2 f(x) if f is continuous at x; 
(ii) if the left-hand and the right-hand limits of f at x exist, denote them by f(x_) and 
f (x4) respectively, and show (Qn * f)(x) > SUF (x4) + f(x-)]; 
(iii) if f is continuous for each x in a closed interval /, then 


(On * f)(x) > f(x) uniformly on J. 


Convergence of Fourier Series 


We have defined the Fourier coefficients of f as 


A l m . 
f(n)= zl f (Oye? do. (2.1) 
2r Jx 


These are well defined for each continuous function on T, or more generally, for each 
integrable function on T The Fourier series of f is the series 


oo A . 
> Amei. (2.2) 


n=—00 


Associated with the series is the sequence of its partial sums 


N 
Swi fi0)= > fime", (2.3) 
n=—N 
N=0,1,2..... If at a point 6 of T the sequence (2.3) converges, we say that the Fourier 


series (2.2) converges at 8. It would have been nice if such convergence did take place 
at every point 6. Unfortunately, this is not the case. There are continuous functions f 
for which the series (2.2) diverges for uncountably many 0. Now we can proceed in two 
directions: 


(1) Weaken the notion of convergence, or 
(2) Strengthen the conditions on f. 


In the first direction we will see that the Fourier series of every continuous function con- 
verges in the sense of Abel summability and Cesaro summability, both of which are weaker 
notions than pointwise convergence of the sequence (2.3). In the second direction we will 
see that if f is not only continuous but differentiable, then the series (2.2) is convergent 
at every point @ to the limit f(@). More generally, this is true when f is not necessarily 
differentiable but is Lipschitz or is of bounded variation. 
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2.1 Abel summability and Cesaro summability 


Consider any series 


[oe] 
> xn (2.4) 
n=l 


with real or complex term xn, n = 1,2,.... If for every real number 0 < r < | the series 
SP2 "Xn converges and if } oc "Xn approaches a limit L asr —> 1, then we say that 
the series (2.4) is Abel summable and its Abel limit is L. 


Exercise 2.1.1. 


(i) If the series (2.4) converges in the usual sense to L, show that it is also Abel summable 
to L. 

(ii) Let x, be alternately 1 and —1. Then the series (2.4) does not converge but is Abel 
summable and its Abel limit is 1/2. 

(iii) Let x, = (—1)"t'n. Show that the series (2.4) is Abel summable and its Abel limit 
is 1/4. 

(iv) In your Complex Analysis course you might have come across this notion while 
studying the radius of convergence of power series. (See, for example. “Abel's Limit 
Theorem” in Complex Analysis by L.V. Ahlfors.) Is there any connection between that 
theorem and what we are doing now? 


Poisson’s Theorem (Theorem 1.3.3) proved in Chapter 1 can now be stated as: 


Theorem 2.1.2. If f is a continuous function on T, then its Fourier series is Abel 
summable and has Abel limit f (0) at every 0. 


Cesaro convergence is defined as follows. For the series (2.4) let 


be the sequence of its partial sums. Consider the averages of these partial sums: 


S| Hs +- tSn 
n 


On = 


If the sequence on converges to a limit L as n —> oo, we say that the series (2.4) is 
summable to L in the sense of Cesàro, or is Cesàro summable to L. This is sometimes also 
called (C, 1) summability or stanmability by the method of the first arithmetic mean. 


Exercise 2.1.3. 


(i) If the series (2.4) converges in the usual sense to L, show that it is Cesiro summable 
to L. 
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(ii) If the series (2.4) is Cesaro summable to L. show that it is Abel summable to L. 


(iii) Show that the converses of statements (i) and (ii) are false. (See the examples in 
Exercise 2.1.1.) 


(iv) If x, > 0, show that the series (2.4) is Cesàro summable if and only if it is convergent. 


We will soon prove that if f is a continuous function on 7, then its Fourier Series is Cesaro 
summiable to the limit f(@) for every 8. In view of the relationship between Cesaro conver- 
gence and Abel convergence (Exercise 2.1.3) this is a stronger result than Theorem 2.1.2. 
However, it is still fruitful to use Abel convergence because of its connection with the 
theory of complex analytic functions. 


2.2 The Dirichlet and the Fejér kernels 


For each integer n let e„ (t) = e". If f is a continuous function on T, then 


n 


(f * €n)(0) = f(ten(@ —ft)dt 


. n . 
= eit fe dt 


= 
— r f ind 
= 2r f (nje. 


Hence, we can write the partial sums (2.3) as 


l N 
Sw(Fi0) = z> } (S * enO) = (f * Dy), (2.5) 
— n=—N 
where 
ET 
Dn(t) = a 2 e", (2.6) 


The expression Dy (t) is called the Dirichlet kernel. 


Exercise 2.2.1. Show that: 


N : 9 
: ime — SIMCNT/2) iN forall t Æ 2k. (2.7) 
a 2: ~ sin (t/2) 7 : * 
ae 2 l 
ii mi| < ———_——_.,_ forall t # 2kn. 
6 ee = Tainaa i 


N . 
1 sin((N + 1/2)t) 
Se = —— for all £42k: 
(iti) Ze nt 5 + sin (1/2) # 


N . 
. sin Nt ; 
(iv) Sof = ae for all t Æ kr. 
sin 
n=l 
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(a) D,(@) 


(b) Dio() 


(c) Dso(@) 


FIGURE 1 
The Dirichlet kernel for different values of n 


. 2 
sın” 


N 
(v) X sin ((2n — 1)t) = 


n=l 


n 
for all t Æ kz. 
EEF or all t 4 Ax 


Hint: Write the sum in (2.7) as 


then use 1 — e" = eff/2(e—t/2 _ git/2), 
Taking real parts of the two sides in (2.7) we get (iii). 
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Proposition 2.2.2. The Dirichlet kernel has the properties 
(i) Dy(-t) = Dy(t). 
Ww 
(ii) J Dy (t)dt =1, 
Ww 


3 1 sin(N + 4)t 
u) D(t) = — ——_— 
RANOR E 


Proof Properties (i) and (ii) are obvious and (iii) follows from 2.2.1 (iii). m 


The Fejér kernel F,,(t) is defined as 


n—l 


F(t) = - Dx (t). : 
i(t) = (t) (2.8) 
Exercise 2.2.3. Show that: 
(i) Fa(—t) = Fa (t). 

yn 
(ii) Fa(Ðdt = 1. 

i i 

1 sin?nt/2 1 l—cos nt 


(iii) Fat) = ——,—— = — 


(iv) Fa(t) > 0 for all t. 


l 
F,(t) < —— f < ; 
) iM) = eel = toe 8) a MES 


n—l 7 
(vi) Fa(t) = > ( = i) et, 


j=—(n-l) 
These properties of F, can be used to conclude: 
Theorem 2.2.4. The sequence Fn is a Dirac sequence. 
This has a most important consequence: 
Theorem 2.2.5. (Fejér’s Theorem) Let f be a continuous function on T. Then the 


Fourier series of f is Cesaro summable to f at every point of T. Further, the convergence 


of the sequence 
l n—l 
onl f: 0) =- DSF 0) 
to f (0) is uniform on T. 


Proof Note that op( f; 0) = (f * Fa) (0). Use Theorem 1.3.1. | 
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-7T 0 T 
(a) Fı(8) 
-7 0 T 
(b) Fio(@) 
-7 T 
(c) Fso(0) 
FIGURE 2 


The Fejér kernel for different values of n 
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In (2.5) we observed that Sy (f; 0) = (f * Dy)(@). Soif Dy were a Dirac sequence we 
could have concluded that the Fourier series of f converges to f. However, this is not the 
case. At this point we will do well to compare the three kernels P,(@). D,(@) and F,,(@) of 
Poisson, Dirichlet and Fejér which we have come across. The following features should be 
noted: 


1. P(t) and F,,(t) are nonnegative for all t but D, (t) is not. 

2. All three are even functions, all attain a maximum at t = 0. But P,(t) decreases mono- 
tonically from 0 to z, whereas D,(t) and Fy (t) are oscillatory. 

3. For D,,(t) and F,,(t) the oscillations become more and more rapid as n increases. How- 
ever, Dn (t) does not die out at +x , whereas F,, (1) dies out at +x for large n. P,(t) also 
approaches 0 fort = +x asr > 1. 

4, The peak of all three at t = 0 goes to co as r > 1, orn > œ. 

5. It is true that the integrals of all three over the interval [—z, 1] are 1. Since P, and Fy, 
are nonnegative we have f7, [P-(t)|dt = fZ, |Fu(t)|dt = 1. However, we will see 
that f7 |Dn(t)| dt goes to œ with n. 

6. Both D, and F, are polynomial expressions in e ien they are finite linear combina- 
tions of e°, Such expressions are called exponential polynomials. The Poisson kernel 
is not of this type. 


n l 7 
Ln =f |Dn(t)|dt = zl 
ay Ir Jr 


are Called the Lebesgue constants. We will see that as n —> 00, Ln —> œ at the same rate 
as log n. 


The numbers 


sin(n + Lyr 


sint/2 mo) 


Exercise 2.2.6. Show that 


(i) sint <t forO<t<x, 


x 


os qs, 
(ii) t < > sint fr0 <t < 


Exercise 2.2.7. Let xn = 1+ l +--+ 1 — logn. Show that x, converges. The limit of 
Xn is called the Euler constant and is denoted by y. Show that 0 < y < 1. Hints: Use the 
fact that [(dt/t) = logt. 


(i) Show that 
Hd dg. toh | 
< — < 7s 
k=? k 1 t kal k 


From this conclude that x„ is monotonically decreasing and 0 < x, < 1. So x, con- 
verges to a limit y. 
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(ii) Use the same idea to show 


Note for all n > 1 we can write 


3 n 
logn = log? +log5 +--- + log — z: 


Use these two facts to obtain 


l 
1 — log? <x, < 1- (1o22 - 5) 


This shows 0 < y < 1. (It is not known whether y is a rational number. An approxi- 
mate value is y = 0.57722. You are likely to come across this number when you study 
the gamma function.) 


Exercise 2.2.8. The aim of this exercise is to show that L, goes to œœ like a constant 
multiple of log n. This can be expressed in any of the following ways: 


(a) There exist constants Cı and C2 such that 

Cilogn < Ln < Cologn for n>2. 
(b) The sequence Ln — (4/77) logn is bounded; i.e., 
(c) Ln = 5 logn + O(1). 


Here is an outline of the proof: 
sin(2n + tfa 


l 2 73 
ENSE f 

m Jo sin u 
(ii) By Exercise 2.2.6 (i) 


La > 


aft 
z 
toju 


sin(2n + Du 
u 


(iii) Now write 


tela 


| 


(iv) Each of these integrals can be estimated from below by replacing u occurring in the 
denominator by the larger quantity 


sin(2n + fau = 2 3 


sin(2n + l)u fau 


nti? af 


k+l x 
n+] 27 


After this the resulting integrals are simple to evaluate. 
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(v) This gives 


Use Exercise 2.2.7 now. 
(vi) At step (ii) above use the inequality of Exercise 2.2.6 (ii) instead, to estimate L,, from 
above. Make a similar change in step (iv). Get an upper bound for L,„. 


Exercise 2.2.9. Estimate L,, in another way as follows: 


3 y 
@ Ly == f 
x Jo 


(ii) Split the integral in two parts; one from 0 to 1/n and the other from 1/n to x. By 
Exercise 2.2.1 (iii) 


sin(n + $)u 


du 
al : 
2sin 7 


sin(n + sya 


2 sin 5$ 


So 


sin(n + 4)u 


] 
du < | + —. 
2sin 5 sit 2n 


[fn 
| 


(iii) For the other integral, use Exercise 2.2.6 (ii) to bound the denominator of the inte- 
grand, and replace the numerator by 1. This gives 


n 
Í, 


sin(n + 4)u 
2 sin 5 


<f Tig m + logn) 
= 2 l/n u 2 & & i 


(iv) So 


2 l 
Ln < logn + log x + — ( + z) F 
T 2n 


(v) Write this in the form 


La < Clogn for n>2. 


2.3 Pointwise convergence of Fourier series 


By the Weierstrass approximation theorem every continuous function on T is a uni- 
form limit of exponential polynomials. (See Exercise 1.3.9; this follows also from Theo- 
rem 2.2.5). In other words if f is a continuous function on T, then for every € > 0 there 
exists an exponential polynomial 


N 
puli) = )> ane" (2.10) 


n=—N 
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such that 


sup |f(t) — pr(O| <€. (2.11) 


—n<i<n 


This can be used to prove: 


Theorem 2.3.1. (The Riemann-Lebesgue Lemma) /f f is a continuous function on T, 
then 


lim f (n) = 0. 


|n|—oo 
Proof We want to show that given an £ > 0 we can find an N such that for all |a| > N we 


have If) < £. Choose py to satisfy (2.10) and (2.11). Note that for |n| > N, p(n) = 0. 
Hence for |n| > N we have 


fin) = f(n) - p(n) = (fZ p)(n). 


But from (2.10) we get 


— l 
IF- pm |= on 


J [f(t) - p(t)je dt 


] 
< —E.2n =£. a 
2x 


Exercise 2.3.2. Let f be a continuous function on T. Show that 


os 


y 
lim Í f(t)cosnt =0, lim f(t)sinnt = 0. 
n= J_y n = 


Exercise 2.3.3. Let f be acontinuous function on 7. Show that 


, E . l 
im f. f(t) sin (( + 5) r) dt =0. 


Hint: Use the two statements of Exercise 2.3.2 replacing f(t) by f(t) sin 5 and f(t) cos 5 
respectively. 


Exercise 2.3.4. If f is continuously differentiable on [a, b], use integration by parts to 
show that 


b 
lim J f(t)sintx dt =0. 
AA K 
a 
This gives another proof of the Riemann—Lebesgue Lemma for such functions. More gen- 


erally, use this method to prove this lemma for piecewise C! functions. [Definition: A 
function f on [a, b] is called piecewise continuous if there exist a finite number of points 
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Aja =00 <a, <+++ <a, = b, such that f is continuous on each interval (aj, aj+1) and 
the limits f(aj;+) and f(a;—) exist for all j. Such a function is called piecewise C | if the 
derivative f’ exists and is continuous on each interval (aj, aj+1) and the limits f"(aj+) 
and f'(aj—) exist for all j.] 


Exercise 2.3.5. Note that the Fourier coefficients f(n) are well-defined (by the rela- 
tion (2.1)) for functions f which are integrable on T. (The term “integrable” may be 
interpreted as Riemann integrable or Lebesgue integrable depending on your knowledge). 
Prove the Riemann—Lebesgue Lemma (and its corollaries) for integrable functions f. Hint: 
If f is integrable, then for every £ > 0 there exists a continuous function g such that 


J lf(t) — g(t)idt < €. 


=n 


Notice, in particular, that piecewise C! functions are integrable and this will give you 
another proof of the second part of Exercise 2.3.4. 
These corollaries too are sometimes called the Riemann—Lebesgue Lemma. 


Theorem 2.3.6. Let f be a continuous (or more generally, an integrable) function on T. 
Let0 < ô < x. Then for every 0, 


-Â z 
lim ( +f ) F6- DD di = 0. (2.12) 
5 


n=% \J-r 


Proof Fix 8, and define a function g on T as 


0 if |t| < 6, 
g(t)= % f(0-t) 
sint /2 


if d < |t| <x. 


—ô x x 
(J + ) f(0 — t)Da(t) dt = al g(t) (sin(n + 1/2)t) dt. 
—T 5 ~_- -j 


Now note that g is integrable and use Exercise 2.3.3 and its extension in Exercise 2.3.5. 
a 


Remark 2.3.7. In particular, choosing f to be the constant function | we get 


—5 bg 
lim (f + ) aOd =o. 
n> OO -x 5 


This property is like Property (iv) of a Dirac sequence Q,, defined in Chapter 1. However 
D, is not a Dirac sequence. What this property signifies is that as n becomes large the 
oscillations of D,, outside any -neighbourhood of 0 cancel each other out. 
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Remark 2.3.8. Theorem 2.3.6 is called the Principle of Localisation. Since 
n 
Sa(f:0)= |  f(@—t)Dylt) dt, 
-xn 


(2.12) shows that the convergence properties of f at @ are completely determined by the 
values of f in a 5-neighbourhood of 6, where ô can be arbitrarily small. So the study of 
convergence of S,,(f; @) is reduced to that of the integral 


5 
J f(@ —t)D,(t)dt 
5 


for arbitrarily small 6. 


This principle can also be stated as follows: if f is zero in a neighbourhood of @, then 
Si(f; 6) converges to zero. Another statement expressing this is: if f and g are equal in 
some neighbourhood of @, then the Fourier series of f and g at @ are either both convergent 
to the same limit or are both divergent in the same way. 

Now we can prove one of the several theorems that ensure convergence of the Fourier 
series of f when f satisfies some conditions stronger than continuity. 

We say that f is Lipschitz continuous at @ if there exists a constant M and a ô > 0 such 
that 


f(6) — fi) <Mle@—t| if jo-t) <6. (2.13) 


This condition is stronger than continuity but weaker than differentiability of f at 6. 


Theorem 2.3.9. Let f be an integrable function on T. If f is Lipschitz continuous at 6, 
then 


lim, Sufi #)= f(@). 
Proof We want to prove 


lim J f(@© —t)D,(t) dt = f(@). 


jim, f Ife- fOD di=0; (2.14) 


for all n, 


t/2 
sin t/2 


ILF (0 —1t) — FJD] < = 
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Hence for 0 < € < § we have 


£ 
[f(@ —t) — f(@)]Dylt)dt| < Ce 
—€ 
for some constant C. Now, use Theorem 2.3.6 to get (2.14). a 


Exercise 2.3.10. Let f be piecewise C! on T. Show that 
dim. Si(f: 9) = f(@) if f is continuous at 6, 


and 


f(04) + f(@_) 
7 


lim Sa(f; 0) = 
n->OO 


if f is discontinuous at 6, and f(6,) and f (6_) are the right and the left limits of f at @. 
Hint: Write 


Sih: a= | fO+DD dra | f(@-—t)D,(t) dt. 
0 0 
] vw 
Su( f3 0) - 51004) + F001 = | [f(6 +t) — f(04)]D,(t) dt 


[ “UFO = 1) — F@)Daltnat. 


Then use the arguments of the proof of Theorem 2.3.9 to conclude that each of the above 
two integrals goes to zero as n —> œ. 

It will be worthwhile to understand how the additional condition on f in Theorem 2.3.9 
has helped. In the proof of Theorem 1.3.1 and that of Theorem 2.3.9 we split the integral 
into two parts. However, in the first case since Q,,(t) > 0, taking absolute values did 
not affect it. In the case of D, (t), however, f |D,(t)| dt becomes unbounded. In this case 
one of the integrals involved goes to zero because of the localisation principle which is a 
consequence of oscillations of D,(t). The other integral goes to zero because for small t 
the integrand in (2.14) is bounded independently of n. For this it is necessary that f itself 
should not be wildly oscillatory. 

We will look at this from another angle also. As we have mentioned earlier, there exists 
a continuous function f for which the sequence 


N 
Sn(f; 6) = >. finet! 
n=-N 


diverges for some @. In Chapter 1 we saw that for each real number 0 < r < | the series 


Le fine? 


converges. We can think of this as the insertion of a “convergence factor” r!"! which con- 
trols the size of the terms. It is true that f (n) — 0 by the Riemann—Lebesgue Lemma but 
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not fast enough for the Fourier series to converge. The insertion of r”! achieves this. What 
happens in Fejér’s Theorem? Notice that we can write the “Fejér sum” oy (f; 0) as 


l N-I 
onf: = = 2 Skif: 0) 


N-I 
= Dp (1- RI) Fine inb 
n=—(N-1) 

Theorem 2.2.5 says that oy(f;0) —> f(@) as N — oo. So, here again the insertion 
of the “convergence factor” 1 — |n|/N seems to have helped. This suggests that if f (n) 
themselves go to zero fast enough, then the Fourier series of f might converge without any 
help from convergence factors. 


Exercise 2.3.11. Let f be a C! function on T with derivative f’. Show that 
Fn) = in f(n). (2.15) 


This is one of the most important facts of Fourier analysis whose importance you will 
discover as you proceed further. 


Exercise 2.3.12. Let f be aC! function on T. Show that 


fin) =0 (G) (2.16) 


i.e., there exists a constant A such that 


à A 
If (m| < mi # 0. (2.17) 


Hint: Use (2.15) and the Riemann—Lebesgue Lemma. Prove (2.16) also when f is piece- 
wise C! 

Thus, whereas the Riemann—Lebesgue Lemma ensures only that f (n) — 0, under the 
additional hypothesis of f having a continuous derivative f (n) —> Oat least as fast as 1 /n. 
In fact the smoother f is the faster is the decay of f(n): 


Exercise 2.3.13. Show that f is a function of class C* on T (i.e. f has continuous deriva- 
tives up to order k), then fin) = = O( l/n*). 

Again, it should be emphasized that this relation between the smoothness of f and the 
size of its Fourier coefficients is an important fact of Fourier analysis. 

Another important class of functions for which (2.16) holds is the functions of bounded 
variation. If P is a partition of [a, b], i.e., a subdivision of this interval as 


a=19 <t) <h <---<t,=b, 
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let 


(f. P) = X IFD - fti). (2.18) 
i=l 


If this sum is less than a fixed number K for every partition P., we say that f is of bounded 
vartation on [a, b] and then its total variation is defined as 


V(f) =supv(f, P), (2.19) 


where the supremum is taken over all partitions P. 


Exercise 2.3.14. 


(i) A function f on an interval [a, b] is said to be uniformly Lipschitz if there exists a 
constant K such that 


f(s) — f()| < K|s —t| forall s,¢ in [a,b]. 


Show that every such function is of bounded variation on [a, b]. 

(ii) Suppose f is a continuous function on [a, b] and has a bounded derivative on (a, b). 
Then f is uniformly Lipschitz on [a, b]. 

(iii) Any piecewise C! function on [a, b] is of bounded variation. 

(iv) The function 


0, t=0, 


TS cea iy ego 


is continuous (and hence uniformly continuous) on [0, 1], but not of bounded varia- 
tion. (Consider the partitions 


(v) If f is of bounded variation on [a, b]. then there exist monotonically increasing func- 
tions g., h such that f = g — h. 


Lemma 2.3.15. If f is a continuous function of bounded variation on T, then 


fin)=0 (G) 
n 


Proof Integrate by parts using Riemann-Stieltjes integrals: 


2L J e`"! df(t) 


2nin Juz 


V(f) 
Pnn ` 


= 


A 1 7 r 
If (m) = Fs fie" dt 


Exercise. Prove this when f is piecewise continuous. 
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For us this information is useful when we apply the following important result: 


Theorem 2.3.16. Let f be an integrable function on T such that f (n) = O(1/n). Then 
Sa(f:80) > (0) at all points @ at which f is continuous. If f is continuous on T, this 
convergence is uniform. 


To prove this we will use a sum which is in between the two sums S,(f; @) and on( f:0) 
introduced earlier. For each pair of integers m, n, where 0 < m < n, define 


Sm+i (fi 0) +- ii + Sil fi 0) 


Om n(f: 0) = PEHEN (2.20) 
Note that we can write 
onadio) = CEDO MEDO aan 
and also 
Om nl fiO) = Sn f+ Y rti fG. (2.22) 
me|jlsn 


One way to see that this is “in between” S, and o, is to write each of these sums as 

(Jae aD ÊG. For the sum S„(f:0) the coefficients œ (j) are 1 for -n < j < n 
and O for |j| > n. For the sum op (f: 6) the coefficients œ(j) drop from the value | at 
j = 0 to the value 0 at |j| = n and stay O after that. For Om.n( f; 0) the coefficients a(/) 
are | for | j| <m and then drop to 0 at | j| =n + 1 and stay 0 after that. (If you sketch the 
graph of œ( j) you will get a rectangle, a triangle and a trapezium, respectively, in the three 
cases.) 

We will look at the special case On, (441) Of these sums. 


Lemma 2.3.17. Let f be integrable on T. Then for each fixed integer k, 


Orn (k+In( fi 0) > f(0) asn > co 


at each @ where f is continuous. If f is continuous on T this convergence is uniform on T. 


Proof From the relation (2.21) write 
Onn (kein (f: 0) = (k +1 +L / noe Ff: 0) — (k + 1/n)onn( £34). 


Then use Fejér’s Theorem (Theorem 2.2.5). Note that you will need to generalise this 
theorem to be able to prove the first statement of this lemma. This is left as an exercise. 


a 
Lemma 2.3.18. Let f be integrable on T and let |f (j)| < A/| jl for j #0. Then for all 
positive integers k, m,n with kn <m < (k + l)n we have 


2A 
lOkn (k+ Unf: 0) - Sn f: @)| < T 
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Proof From the relation (2.22) we get 


lOknk+ n (fiO) — Sm(FOlS Yo LAU 
kn<[j|<(K+1)n 


(A+L)a 
25 Se 
jokntt / 


Proof of Theorem 2.3.16 We are given that there exists a constant A such that | f (PI < 
A/\j| for j # 0. Lete > 0 be given. Choose an integer k such that A/k < é/4. By 
Lemma 2.3.17 we can find no > k such that for all n > ng, 


E 
lOkn.k+n(f; 0) — f(0)| < 5° 


Now let mm > kno. Then for some n > ng we will have kn < m < (k + Dn. Hence by 
Lemma 2.3.18, 


2A e€ 
lOkn ck+Dn(F3 8) — Smf: 4)| < T < 5: 
From the above two inequalities it follows that 
ISm(f; 6) — f(0)| <€. a 


The most important corollaries of Theorem 2.3.16 are the following theorems: 


Theorem 2.3.19. (Dirichlet’s Theorem) Let f be a piecewise C} function on T. Then 
the Fourier series > f (nye? converges to f(@) at every point @ where f is continuous. 
This convergence is uniform on any closed interval that does not contain a discontinuity 


of f. 


Theorem 2.3.20. (Jordan’s Theorem) The conclusion of Dirichlet's Theorem is valid, 
more generally, if f is any function of bounded variation on T. 


Exercise 2.3.21. Recall that a function of bounded variation is continuous except possibly 
at a countable set of points: and at these discontinuities the left and the right limits exist. 
Show that if 8 is a point of discontinuity of f, then the Fourier series )> finje”? converges 
to z{f (04+) + f(6-). 

Let us make a few more remarks about the condition f (n) = O(1/n) under which we 
have proved our Theorem 2.3.16. In Chapter 3 we will see examples of functions that are 
piecewise C! (and hence, of bounded variation) for which the Fourier coefficients decay 
exactly as I/n. If f isa C l function on T, from the Riemann—Lebesgue Lemma and (2.15) 
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we get a Stronger result than (2.16): we have 
a l 
f(n) =o (<) : (2.23) 
n 


i.c., liMp—soo a (n)/n = 0. There is another class of functions in between C ' functions 
and functions of bounded variation that is useful, especially in the theory of Lebesgue 
integration. This is the class of absolutely continuous functions. 

A function f on [a, b] is said to be absolutely continuous if for every € > 0, there exists 
ô > 0 such that whenever {(a;. b;)} is a finite disjoint collection of open intervals in [a, b] 
with )-y_, (bj — aj) < ô, then we have } lf (bi) — f(ai)| < E. 


Exercise 2.3.22. Prove the following statements. 


(i) Every absolutely continuous function is uniformly continuous. 
(ii) Every absolutely continuous function is of bounded variation. 
(iii) If f is uniformly Lipschitz, then f is absolutely continuous. 
(iv) In particular if f has a bounded derivative on (a, b), then f is absolutely continuous. 


The Fundamental Theorem of Calculus says that if f is absolutely continuous on [a. b], 
then it is differentiable almost everywhere, its derivative f’ is integrable, and 


t 
so=f f'(s)ds+ f(a) foralla <t <b. 


Conversely, if g is in Ly[a, b], then the function G (t) = I g(s)ds is absolutely continu- 
ous, and G’ = g almost everywhere. (See c.g., H.L. Royden, Real Analysis.) 


Exercise 2.3.23. Show that if f is absolutely continuous, then f (n) = o(1/n). In particu- 
lar, this is true if f is a continuous function that is differentiable except at a finite number of 
points, and the derivative f’ is bounded. (This is the case that arises most often in practice.) 


Exercise 2.3.24. In Exercise 1.3.10 we saw that the convolution f * g inherits the better of 
the smoothness properties of f and g. This idea goes further. Show that if g is of bounded 
variation, or is absolutely continuous, then f * g has the same property. 


We add, as a matter of record, that there exist continuous functions of bounded vari- 
ation for which f # o(1/n). (The standard example of a continuous, but not absolutely 
continuous, function of bounded variation involves the Cantor set.) 


2.4 Term by term integration and differentiation 


If $ falx) = f(x), and the series converges uniformly, we can obtain f f by integrating 
the series term by term. For Fourier series we can perform term by term integration even if 
the series does not converge at all. 

Let f be any piecewise continuous (or, more generally, integrable) function on T. Let 
Cn = f (n). Let 
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F(x)= Í f(t) dt — cox, -N IEX <7. 
0 


Then F is absolutely continuous, F(0) = 0 and F(x) = F (—x). Since F is absolutely 
continuous, its Fourier series 


XxX 
F(x) = 5 Apne” 
n=- 
converges uniformly. The coefficients c, and A, are related by the equation c, = inAy. 
From this we get 


. 
A, =—i— forn Æ 0. 
n 


The condition F (0) = 0 then shows 


This shows 


x c . 
Í f(t) dt = cox +1 y= -i D Cn pinx, (2.24) 
0 n£0 n n#0 n 


This is exactly what we would have obtained on integrating the series 


x 
fO= Yo ene (2.25) 


n=% 


term by term from 0 to x. We have proved the following. 


Theorem 2.4.1. Let f be any function in L! (T) with Fourier series (2.25). Then the func- 
tion de f (t) dt is represented by the series (2.24). The latter series is uniformly convergent 
on T, even though the former may be divergent at some points. 


Note that the series (2.24) is not quite a Fourier series because of the presence of the 
first term. Subtracting this term we get the Fourier series for the periodic function F(x). 
How about term by term differentiation? 


Exercise 2.4.2. Let f be a continuous and piecewise C! function on T Show that if f’ 
is piecewise C!, then the Fourier series f (t) = $` f (n)e!" can be differentiated term by 
term, and the series so obtained converges pointwise to Ti f'(t+)+f'(t_)]. (Use Dirichlet’s 
Theorem.) 


The conditions of Exercise 2.4.2 are satisfied by functions like f(t) = |t| and f(t) = 
| sin t]. 
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2.5 Divergence of Fourier series 


We have informed the reader earlier that there exists a continuous function whose Fourier 
series diverges at some point. An example of such a function was constructed by Du Bois- 
Reymond in 1876. This example came as a surprise because it was generally believed by 
Dirichlet and, following him, by other mathematicians like Riemann and Weierstrass that 
the Fourier series of a continuous function should converge at every point. 

To construct this example we make use of the fact that the Lebesgue constants Lẹ, tend 
to oo. We start with trigonometric polynomials with large Fourier sums, and combine them 
to get successively nastier functions whose limit behaves more wildly than any function 
whose formula could be explicitly written down. This idea is called the method of conden- 
sation of singularities. 


Exercise 2.5.1. 


(i) Let A be any positive real number. Choose N so that the Lebesgue constant Ly > A. 
Let gn(t) = sgn Dy (t); i.e., gu (t) = 1 if Dy(t) > Oand gy(t) = —1 if Dx(t) <0. 
Then the Fourier sum 


Sn(gn; 0) = LN > A. 


(ii) The function gy is a step function having a finite number of discontinuities in 
[—7, z]. For each £ > 0 we can find a continuous function g such that |g(t)| < 1 and 
fee lg(t) — gn(t)|dt < £. (Sketch a piecewise linear function with this property.) 
Use this to show that there exists a continuous function g on [—x, 1] with |g(t)| < 1 
and |Sw(g; 0)| > A. 

(iii) Use the Weierstrass approximation theorem to show that there exists a trigonometric 
polynomial p such that |p(t)| < 1 for all t in T and |Sy(p;0)| > A. In other words, 
for each A > 0, there is a natural number N and a trigonometric polynomial p(t) = 
SiL a P(ndei™, such that 


M 
> P(nye™| <1 forallt erT, 
n=-M 
but 
N 
> P| > A. 
n=—N 


Theorem 2.5.2. (Du Bois-Reymond) There exists a continuous function f on T whose 
Fourier series diverges at the point 0. 


Proof Using Exercise 2.5.1 (iii) we can find, for each k = 1, 2,... , a trigonometric poly- 
nomial 
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m(k) D 
p= $ PA (2.26) 
j=—m(k) 
such that 
IPO <1 forallt eT (2.27) 


and a positive integer n(k) such that 
n(k) 


>> Pe) 


j=—n(k) 


So (2.28) 


We may assume, by adding zero terms if necessary, that m(k) > n(k) and m(k) > m(k— 1). 
Now let 


k 
r(k) = [2m(j)+ 1] 


j=l 
and 


n 


l 
fat) = = La er p, (t) 
k=l ak 
n m(k) l 
= T ell +A Fj), (2.29) 
k=l j=—m(k) ~ 


From this it is clear that if n > k and |j| < m/(k), then 
A l ‘eae 
Jalr(k) + j) = sy Pk), (2.30) 
and 
faj) =0 forall j <0. (2,31) 


Ifn’ >n +1, then 


, 
n 


l etr 
2 ge O 


k=n4+1 ~ 


lJa (t) = falt) = 


, 
n 


l 
< J, gaODI 


So by the Weierstrass M-test the sequence fa converges uniformly on T to a continuous 
function f. The properties (2.30) and (2.31) are carried over to f. Using these two proper- 
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ties we see that 


[Srn Fs 0) — Sre- fi 0)| 


r(k)+a(k) ` rik)—n(k) . 
=| >> fD- ff 
j=0 j=0 


n(k) : 
SO fork +f) fek — ntk) 


j=—n(k) 


n(k) 
DO Bei) Pkk) 
j=—ntk) 


>> Pei) 


j=—n(k) 


— | Pe(ntk))| 


using (2.27) and (2.28). As k — oo this expression goes to oo. Thus the sequence Sy (f; 0) 
cannot converge. E 


Note that our proof shows that lim Sn( f: 0) = œ. 

The method of condensation of singularities has been found to be very useful in other 
contexts. Some of its essence is captured in one of the basic theorems of functional analysis 
called the Uniform Boundedness Principle or the Banach-Steinhaus Theorem (discovered 
by Lebesgue in 1908 in connection with his work on Fourier series; and made into a general 
abstract result by Banach and Steinhaus). We state the principle and then show how it can 
be used to give another proof of Theorem 2.5.2. 


The Uniform Boundedness Principle. Let X and Y be Banach spaces and let Ay be a 
sequence of bounded linear operators from X to Y. If the sequence ||Ay|| is bounded for 
each x in X, then the sequence ||Ay}| is also bounded. 


Let X be the Banach space C (T ) consisting of continuous functions on T with the norm 
of such a function defined as 


fll = sup | f(D). (2.32) 
teT 
Now define a sequence of linear functionals on X as 


An(f) = Sn (fi 0). (2.33) 
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Note that 


lAn( P| = 


f(t)Dy(t) dt 


n 


SIFI f (Dade 
-xn 
= Lali fN, (2.34) 
where L, is the Lebesgue constant. In particular this shows that 
Ani] < La foreach n. (2.35) 
We will show that 


lAn = Zn for each n. (2.36) 


Fix n. Let g(t) = sgn D,(t). As seen in Exercise 2.5.1, we can choose a sequence Qm 
in C(T) such that |dn(t)| < 1 and limy—oo¢m(t) = g(t) for every t. Hence, by the 
Dominated Convergence Theorem, 


n 
im An(@m) = nim | Í P m(t)Dn (t) dt 


=f g(t)Dn(t) dt 


-70 
n 
= f Daodi. 
-0 
Since |l¢m|] = 1, this proves (2.36). So ||^nÌ| is not a bounded sequence. Hence by the 


Uniform Boundedness Principle there exists an f in the space X = C(T) such that the 
sequence 


lAa (f) = Saf: 0)| 


is not bounded. Therefore, the Fourier series of f at 0 does not converge. 

Let us make a few remarks here. The point 0 was chosen just for convenience. The same 
argument shows that for each point @ on T we can find a function f such that |S,(f: ©) 
is not bounded. The Uniform Boundedness Principle is (usually) proved using the Baire 
Category Theorem. Using these methods one can see that the set of all functions whose 
Fourier series converge at 0 is a set of first category in the space C(T). In this sense 
continuous functions whose Fourier series converge everywhere form a meagre set. Using 
a little more delicate analysis one can show the existence of a continuous function whose 
Fourier series diverges except on a set of points of the first category in 7, and the existence 
of a continuous function whose Fourier series diverges on an uncountable set. (See W. 
Rudin, Real and Complex Analysis, Chapter 5). 

One may now wonder whether it is possible to have a continuous function whose Fourier 
series diverges everywhere. 
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After Du Bois-Reymond’s result, this is what mathematicians tried to prove for sev- 
eral years. In 1926, A.N. Kolmogorov constructed a Lebesgue integrable function on T, 
i.e.. a function in the class L'(T). such that |Su(f: 9)| diverges for all 6. Though Kol- 
mogorov’s function was not Riemann integrable, this encouraged people in their search for 
a continuous function whose Fourier series might diverge everywhere. However. in 1966, 
L. Carleson proved that if f is square integrable, i.c., in the space L?(T), then the Fourier 
series of f converges to f almost everywhere on 7. In particular if f is continuous, then 
its Fourier series converges almost every where. 

Another natural question may be raised at this stage. Given a set E of measure zero in 
T, can one find a continuous function f on T such that |S,,(f; @)| is divergent for all 6 
in E? The answer is yes! This was shown by J.P. Kahane and Y. Katznelson soon after 
Carleson’s result was proved. 

So Fourier was wrong in believing that his series for a continuous function will converge 
at every point. But he has been proved to be almost right. 


Odds and Ends 


3.1 Sine and cosine series 


A function f is called odd if f(x) = —f(—x) and even if f(x) = f(—x) for all x. An 
arbitrary function f can be decomposed as f = feven + foda, Where feven(x) = zÍ f(x)+ 
f(—x)] and foaa(x) = Ai f(x) — f(—x)]. The functions feven and fogg are called the even 
part and the odd part of f, respectively. Notice that if f(x) = e* then feven(x) = cos x 
and foad(x) = i sin x. 


Exercise 3.1.1. Show that if f is an even function on 7, then f (n) = f (—n), and if f is 
odd, then f (n) = — f (—n). In other words the Fourier coefficients are also then even and 
odd functions on the integers Z. 


So if f is an even function on 7, then 


N 
Sn(f:0) = ys fine”? 
n=—N 


N 
= f (0) + 25° f(n) cosnð. 


n=l 


Also note that if f is even, then 


m 


f(n) = = f(t)(cosnt — i sinnt) dt 
27 Jr 


l n 
=- f f(Ðcosnt dt. 
T Jo 
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Putting a, = 2 f (n), we can write the Fourier series of an even function f as 


foe] 
ag 
a + a cosné, (3.1) 
n= 
where 
l n 
An = — f(t) cosnt dt. (3.2) 
T J—n 


This is called the Fourier cosine series. 
In the same way. if f is an odd function on T, then we can write its Fourier sine series 


as 
[00] 
ba sinnô (3.3) 
n=l 
where, 
l n 
ba = — fÐ sinnt dt. (3.4) 
T Jon 


The Fourier series of any function on 7 can be expressed as 


ao 


foe) 
ae Yan cosn@ + b, sinn@), (3.5) 


n=l 


where an and b, are as given above. In several books the series (3.5) is called the Fourier 
series of f and is taken as the starting point. Let us say that (3.5) is the Fourier series in 
its trigonometric form and 


e9 . 
> cne”? (3.6) 


n=—0O 


is the Fourier series in its exponential form. 

Exercise 3.1.2. If (3.5) and (3.6) are the Fourier series of the function f, show that 
Qn = Cn + Con, bn = Í (Cn — C-n), 

and for n > 0, 


l ‘ ] 
Cn = 5 (an — ibn), Cen = 5 (an + iby). 


Exercise 3.1.3. The series (3.5) can be integrated term by term to give 
2e] b CO 


| i f(0)do = 2> + DEED Mi ee 3.7 
- a — sinnx — —cosnx }. 
0 2 n n n : eA 


n=l n=l 
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If f is sufficiently smooth, the series (3.5) can be differentiated term by term, and then 


[oe] 
f‘@)= X (nbn cos nô — nan sin n8). (3.8) 


n=l 


(Sce Section 2.4) 


Exercise 3.1.4. We have seen above that if f is a continuous even function on T. then 
given an £ > 0 there exists a finite sum g(6) = per Qn COS nO such that 


sup | f(@) — 2(@)| < e. (3.9) 
QET 


This can be used to prove the Weierstrass approximation theorem as follows: 


(i) Show, by induction, that there exists a polynomial T of degree n with real coefficients 
such that 


cosn@ = T,,(cos @). (3.10) 


Tn is called the Tchebychev polynomial of degree n. 


(ii) Let y be any continuous function on (0, 1]. Define a function f on T by f(0) = 
(| cos @|). Then f is an even continuous function. Use (3.9) and (3.10) to show that 


N 
sup |y(t) — Yo anTa(t)| < E£. 
Osrsl n=0 
This shows that every continuous function on [0, 1] is a uniform limit of polynomials. 


(iii) By a change of variables show that every continuous function on an interval [a, b] is a 
uniform limit of polynomials. This is called the Weierstrass approximation theorem. 


(iv) Show that this result and the one we proved in Exercise 1.3.9 can be derived from 
each other. 


Exercise 3.1.5. Use the Weierstrass approximation theorem to prove that if f and g are 
continuous functions on [a, b] such that 


b b 
J x" f(x)dx = | x" 9(x) dx 


for all n > 0, then f = g. (This is called the Hausdorff moment theorem and is very useful 
in probability theory). 


3.2 Functions with arbitrary periods 


So far, we have considered periodic functions with period 277, identified them with func- 
tions on T and obtained their Fourier series. A very minor modification is required to deal 
with functions of period 2L, where L is any real number. If f is periodic with period 2L, 
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then the function g(x) = f(xL/z) is periodic, with period 27. So, we can first derive the 
Fourier series for g and then translate everything back to f by a change of variables. All 
the results proved earlier remain valid with appropriate modifications. 


Exercise 3.2.1. Let L be any positive number and let f be an integrable function on 
[—L, L] with f(L) = f(—L). Then the Fourier series of f can be written as 


>. A einan/L 
n ` 


where 
2 1 re stay 
An = al. fe"! dt. (3.11) 


In the same way. if f is even, then its cosine series can be written as 


l z nxn 
740 + yo An COS ia 


n=l 


where 
2 fL ntr 
An = a f(t) cos —— dt: (3.12) 


and if f is odd, then its sine series can be written as 


[oe] s 
>» Ba sin ule 
L 
n=l 
where 
2 rt t 
Bn = a fD sin dt. (3.13) 


Now we come to an interesting bit: how to apply these ideas to any function on a bounded 
interval. Let f be any continuous (or piecewise C!) function defined on the interval (0. L]. 
Extend f to[—L. L] as follows. Define 


f(0) = f(O+), 
f(—x) = f(x) for0<x <L. 


This gives a continuous (or piecewise C!) function on [—L. L]. Now extend f to all of R 
by putting 


f(x +2L) = f(x) forall x. 


This is an even continuous (or piecewise C !) function defined on all of R having period 2L. 
So we can expand f into a cosine series. Notice that our extended function is continuous 
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at x = 0 and x = L. We could also have extended f to an odd function as follows. Define 
f0) = 0, 
f(-x)=—-f(x), O<ax SL. 
This extends f to [—L, L]: and now extend f to R by putting 
f(x +2L) = f(x) forall x. 


Now we get an odd periodic function. Notice that now f(0) = 0 and f is discontinuous at 
L with f(L-) = —f(L4). So we can expand f into a sine series also. 

This apparently anomalous situation—the possibility of expanding any function as a 
sum of periodic functions and further the possibility of expanding the same function as both 
a sum of even functions and a sum of odd functions—was a part of the raging controversy 
at the beginning of the subject. See Chapter 0. 


Examples in the next section will clarify further how this apparent anomaly is neatly 
resolved by our analysis. 


3.3 Some simple examples 
Example 3.3.1. Let f be the “pulse function’ defined as 


l if—-r<x<0. 
fO<x <7, 


fœ = R 


and extended periodically to all of R. This is an odd piecewise C ' function with jumps at 
0, tr, 427,.... The average value of f at these points is 0. The Fourier series of f is a 
sine series like (3.3) with coefficients given by 


49 n 
T JO 


So 


7 4/nn ifn is odd, 
"10 if n is even. 


Hence we have 


4 /sinx sin3x — sin5Sx ) 
x)= — | —— +). (3.14) 
f(x) m ( i + 3 + 5 
Atx = 0. +. +27, ..., the series adds up to zero which is the average value of f at these 


points. At other points it converges to f(x). Figure 1 shows the pulse function. Its Fourier 
sums for 1, 2, 10 and 100 terms are shown in the next figure. 
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FIGURE 1 
The pulse function 


(a) Si(f; 0) 


(b) So(f; @) 


A 


(c) Sio( f; 4) 


= 


(d) Sioo( f; 4) 


FIGURE 2 
Fourier sums of the pulse function for different values of N 
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Example 3.3.2. Now consider the pulse function with a different width. Let 


-l for -l<yx<0O, 
fo) =| | forO<x <1 
and extend it to R as a function with period 2. Show that the Fourier series of f is 
4 /sinzx — sin3xx — sinSmx 
fa) = — + —— + — +t]. (3.15) 
1 l 3 5 


Note that the Fourier coefficients of f in Examples 3.3.1 and 3.3.2 are the same, but the 
wavelengths of the sine waves have been adjusted. (The amplitude of the wave is the same 
as before, the wavelength is shorter.) 


Example 3.3.3. The function 


0 fr-l<x<0. 
ra=]! forO<x <1 


is called the Heaviside function. Extend it to R as a function with period 2, and show its 
Fourier series is 


l1 2 (25 sin 37x A sin 57x +) (3.16) 


x\ | 3 5 


2° 
Obtain this directly from the preceding example. 
Example 3.3.4. Let 
+x for -z7<x<0O, 


fa) = 


—-x forO<x<z 


Nl Awl] a 


and extend f to R as a periodic function with period 27. You get a “triangular wave” with 
amplitude 7/2 and period 27. Show that f has the expansion 


(3.17) 


Pee 4 /cosx a cos 3x ) 
per nx\ |? 3? 


Example 3.3.5. Let f be defined on [0, 1) as 
fa) =x. O<x<l. 


Extend f to R as an even function by the prescription in Section 3.2. This gives a saw-tooth 
curve shown in Figure 3. This is an even continuous function with the cosine series 


l 4 (sr cos 3x e); (3.18) 


Cog ae R 


If we extend f to an odd function by our prescription we get the function shown in Figure 4. 
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FIGURE 3 


The even saw-tooth curve 


FIGURE 4 
The odd saw-tooth curve 


This has discontinuities at all odd integers, where the average value is zero. The Fourier 
series is now a Sine series 


f(x) = (3.19) 


a Gn ea a 


2 (= mx sin2xx  sin3rx ) 
We can extend f beyond its original domain in one more way. We put f(x) = 1 + x for 
—1 <x < 0, and then extend the function to all of R as a periodic function with period 2. 
This gives the function (neither even nor odd), see Figure 5(a). 


(a) 


(b) 
FIGURE 5 


Two more extensions of the saw-tooth function 
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We can obtain the Fourier series for this function from (3.19) in three steps. First con- 
sider the odd function g(x) = x, -4 <xy< T and extend it to R as a periodic function 
with period 1. The amplitude and the wavelength of g are half those of the function fin 


(3.19). So 


l /sin2nzx  sin4nx  sin6rx 
a(x) = — 
x l 2 3 


The function f whose Fourier series we want can be expressed as f(x) = g(x — 4) + 
So its Fourier series is 


1 
2° 


l l (= 2x $ sin4ax  sin6rnx 3.20 
I 2 3 ae 


A fourth way of extending the original function of this example is as follows. Let 


x for -l <x <1, 
f= 4 2-x forl <x <2, 
—2-—x for -—-2<x<-l. 


Then extend f to all of R as a periodic function with period 4. This gives an odd triangular 
wave, see Figure 5(b). A calculation shows that f has the Fourier series 


sinax/2  sin3zx/2 — sinSax/2 ) (3.21) 


8 
PN (an 


We have thus four different periodic functions that coincide with f(x), forO < x < 1. 
Their Fourier series are given by the formulas (3.18)-(3.21). The first function is even, the 
second and the fourth are odd. the third is neither even nor odd. Two of the four functions 
are continuous. The corresponding series (3.18) and (3.21) are uniformly convergent. The 
series (3.19) and (3.20) converge uniformly on closed subintervals of (—1, 1) and (0, 1) 
respectively. At the points x = n, where n is an integer, the series (3.19) converges to the 
value 0. and the series (3.20) to the value 1/2. 


Example 3.3.6. Let 


—cosx if —-m <x <Q, 
fx)= 7 0 if x = 0. 
cosx fO<x <7 


and extend f to R as a periodic function with period 27. This is an odd function with 
discontinuities at x = nr. Show that the Fourier series of f is given by 


foe} . 
8 5 nsin2nx (3.22) 


x 4n?—1— 
n=l 
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If we differentiate this series term by term, we obtain 


9 
16 Sv nt cos 2nx 


x 4n? — 1 
n=l 


This series is divergent. (See Exercise 2.4.2). 


Example 3.3.7. Let f(x) = x’, =x < x < x, and extend this to R as a periodic function 
with period 27r. The Fourier cosine coefficients of this even function can be calculated by 
integrating by parts twice. We get 
2 oo 
aon” n COS nx = 5 
oe a +4) (-1) is for -n <x <7. (3.23) 


n=l 


This series can be differentiated term by term (see Exercise 2.4.2) to get 


CO r 
x= 2) en for =n <x <7. (3.24) 


n 
n=l 


This is the series we have obtained in (3.19). In the reverse direction, we can integrate term 


by term the series obtained for x in Example 3.3.5 and obtain different series for x7. Thus, 
the series (3.20) leads to 


to 


x 
2 


ae | © cosnx 
=xnx—2 — +2 forO < x < 2x. (3.25) 
3 n? 2 n? 


Integrating the series (3.18) we get 


2 8 A sinnx 
X =mx-— ) 3 forO <x <7. (3.26) 
x n 
n=l 
These are not Fourier series. If we substitute in them the Fourier series for x (in the appro- 


priate domains) given by (3.20) we obtain from (3.25) 


ELE Yecaly ye N ee ia 
EE 2. 7 sid P orQ <x < 27, (3.27) 


n=l 


using the fact 5° 1/n? = m7 /6 (see (3.39)), and from (3.26) 


9 S s 
2 E i. 8 SS sinnx 
Sy TK ) a ) zo forO<x<nZ. (3.28) 
2 n- 
n=l n=l 


Yet another series representation for x? is given in Exercise 3.5.2. 


Example 3.3.8. Show that the Fourier series for the function | sin x| is 


f 2 4X cos2nx 
sinx| = — — — 
[sin x] = — — — È (3.29) 


4n? — 17 


ODDS AND ENDS 61 


This representation is valid for all x € R. Show that the Fourier series for the function 


0 for -mn <x <0, 
siny forOQ<x<z7 


f(x) = | 


] siny 2 Qvcos2nx 
x 2 x dn? — 10 
n=l 


(3.30) 


3.4 Infinite products 


Let {an} be a sequence of real numbers. How do we define the infinite product Na,? We 
can imitate the definition of an infinite sum. For each N = 1,2,... let py = ayan---ay 
be the sequence of partial products of {an}. If this sequence converges to a limit p and 
p £ 0, we say that the product Ma, converges, and write 


Los) 
I] Qn = p 
n=l 


Note that if any a, = 0. then the product is zero. This case is uninteresting. Further, if 
Pn converges, then a, too has to converge to |. So, after ignoring the first few factors, we 
may assume that a,, > O for all n. In this case loga, is meaningful, and we can convert 
questions about products to questions about sums. 


Exercise 3.4.1. Let a, > 0 forn = 1,2,.... Show that the product Ma, converges if and 
only if the series }_ log a, converges. 


Exercise 3.4.2. 
(i) Show that if |x] < 1/2, then 


l 3 
ail < jlog(1 + x)| < zll 


Hint: For |x| < 1, we have 
Pe gd E, 
log(1 Ta Eg = qr 
(ii) If a, > —1 for all n, then the series ` | log(1 + a„)| converges if and only if X lanl 
converges. 
Let {a,,} be a sequence of positive real numbers. If the series } “log an converges 


absolutely, we say that the product Ma, converges absolutely. 


Exercise 3.4.3. Let a, > 0 for all n. The product Ma, converges absolutely if and only if 
the series } (an — 1) converges absolutely. 
Uniform convergence of products like M fy(x) can be defined in the same way as for 


series. 
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We will derive now some important product representations for trigonometric functions. 


Consider the function 


f(x) = cos tx, -n <t <7, t not an integer. 


This is an even function. Its Fourier cosine series can be determined easily. We have 


2 sintz 
ag = — i 
N t 
(—1)” 2t sintz 
An = T 
s m P-R 
Thus we have 
; 2t sin tr l cosx cos 2x 
costx = —— | — - ——~ + ———_- —- -::- ]. 
x W? R-P r-z 


Choosing x = x, we obtain 


cost 2t % l fi l i 
sintim 7 -P 72-2? f 


This can be rewritten as 


cotrt l aay l 3.31 
nt n Sp? =n? Gan 
or as 
reotnt ==+ 5 re 3.32 
E azo \t n i (2a) 


where the last summation is over all nonzero integers. 


This is a very important formula. It is called the resolution of the cotangent into partial 


fractions. 
IfO <t <a <1, the series in (3.31) is dominated by the convergent series 


l 


) =~. 
ho a? 


Hence the series is uniformly convergent and can be integrated term by term in this domain 
Performing this integration, we see that for 0 < x < 1. we have 
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Taking exponentials of both sides we get the marvelous product formula 
sinx Il i x? 
a aj (3.33) 


Exercise 3.4.4. Use the relation cos 7.x = sin 27 x /(2 sin z x) to obtain from this the prod- 
uct formula 


= 4x? 
cos7Tx = I] ( i Qn — 2 ; (3.34) 


Exercise 3.4.5. Show that 
9 x l 


a2 
= —. (3.35) 


- ? 
sinx „£ (x2 n)? 


Exercise 3.4.6. We have obtained these infinite series and product expansions for 0 < 
x < 1. Show that they are meaningful and true for all real x. (They are valid for all 
complex numbers, and are most often included in Complex Analysis courses.) 


Exercise 3.4.7. Show that 


2 SaS TER 
sinx x x-nr x+ann | 


n=l 


3.5 ~ and infinite series 


The number z has allured, fascinated and puzzled mathematicians for over two millenia. 
Approximations to x and formulas for it have been among the prize discoveries of famous 
mathematicians. Fourier series provide an inexhaustible source for such formulas. Some of 
them are given below. You can certainly discover more. 

Choosing x = 7/2 in (3.14) we get 


Oe Peg eee (3.36) 


This seems to be the earliest example of a series involving reciprocals of integers and 7. It 
was discovered by Nilakantha in the fifteenth century via the series 


r? x? 
E E i se, 3.37 
arctan x = x a +5 ( ) 


valid for |x| < 1. This series was known to the fourteenth century mathematician Madhava. 
These series are now generally known as Leibniz—Gregory series. 
Choosing x = 0 in (3.17) we get 


=l+s34+=—at--:. (3.38) 


n? l l 
8 32 5? 
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From this we can derive Euler’s wonderful and famous formula discovered in 1734, 
—=lt+atate. (3.39) 

Note that the series on the right is convergent and its sum is bounded by 2. This was noticed 


by the Bernoulli brothers (Jakob and Johann) who asked for the exact value of the sum. 
Rearranging its terms we can write 


Using this we get (3.39) from (3.38). (Euler’s proof was different and is discussed later.) 
Choosing x = 1/4 we get from the series (3.19), 


I l l 1l 
Peete os (3.40) 


a series in which two negative signs alternate with two positive signs. Choosing x = 1/2 
in (3.21) we get 


w l l l l 


sA z gtp (3.41) 
Choosing x = 7/2 in (3.26) we get 
i re O | 


N l l l ] 
mia +(+) (aal 


l 
araa (3.44) 


Exercise 3.5.2. Use (3.25), (3.39) and a rescaled version of (3.20) to show 


n 


2 44 © /cosnxy  nsinnx 
j =37°+4)( a ). (3.45) 


n=l 


fr <x < 27. 
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Exercise 3.5.3. From the product formula (3.33) obtain the Wallis formula 


Exercise 3.5.4. Show that 


3.6 Bernoulli numbers 


This is an important sequence of rational numbers discovered by Jakob Bernoulli. These 
numbers arise in several problems in analysis. 

Let B, (x) be the sequence of functions on the interval [0,1] defined inductively by the 
conditions 


(i) Bo(x) = 1, 
(ii) B(x) = Bn (x) forn = 1,2,..., 


These conditions determine uniquely a sequence of polynomials called Bernoulli polyno- 
mials. The first four are given by 

Bo(x) = 1, 

B(x) = x — 1/2, 

Bo(x) = x?/2 — x/2 + 1/12, 

B3(x) = x?/6 — x?/4 + x/12, 

By(x) = x?/24 — x?/12 + x?/24 — 1/720. 


Exercise 3.6.1. Show that 


(i) By(x) is a polynomial of degree n. 
(ii) Ba(x) = (— D)" B (l — x) for all n > 0. 
(iii) B, (0) = B,(1) forall n > O except n = 1. 


(Note B,(0) = — Bı (1) = —1/2.) 
The Bernoulli numbers are the sequence B, defined as 


Ba = n!B, (0). (3.46) 


We should warn the reader here that different books use different conventions. Some do 
not put the factor n! in (3.46) while others attach this factor to By, (x). 
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Exercise 3.6.2. Show that 
poe yee (3.47) 
i r l 
Use Exercise 3.6.1 to show that Bp = 1, and for n > 1, 
l n—l l 
BSar ey (" + ) bs (3.48) 
n+l k 
The last relation can be written out as a sequence of linear equations: 
1+2B, =0. 
1+3B,+3B2 =0, 
1+4B, + 6B2+ 4B; = 0. 


1+ 5B, + 10B2 + 10B3 + 5B, = 0. 


From here we see that 


Bı =-1/2, Bo=1/6. B3=0, Bs=—1/30, Bs =0, 
Bo = 1/42, By =0. Bg =-—1/30,.... 
Exercise 3.6.3. Show that 
t S Bus 
aA (3.49) 


(Hint: Write down the power series for e' — 1, multiply the two series, and then equate 
coefficients.) From this we see that 


I t Bn n 
rasiti e (3.50) 


e —] 


The left-hand side can be rewritten as r(e’ + 1)/2(e' — 1). This is an even function of r. 
Hence we must have 


Ban =O forn> 1. (3.51) 


What has all this to do with Fourier series? We have seen that the functions B, (x), n > 2 
are periodic on R with period 1. The function B, (x) has the Fourier series 


1 Qvsin2anx 
B(x) = —— —, O<x <1. 
x) = -— — <x < (3.52) 


n=l 
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(See (3.20)). Repeated integration shows that form > 1, 


2 œ 4 R 
, eat. 2 cos 27x 
Bay (x) = (—1)" mae 2 aa (3.53) 
n= 
? X ein? ; 
er a E E sin 27rnx 
Bangi (x) = (—1) Orya" 3 my (3.54) 
n= 


for 0 < x < 1. (This shows again that Bom+ | = 0 forall m > 1.) 
The Riemann zeta function is the function 


g(s) = Te (3.55) 


a meromorphic function defined on the complex plane. We will be concerned here only 
with its values at positive integers. We have seen formulas for ¢(2) and ¢(4) in (3.39) 
and (3.44). More generally we have the following. 


Theorem 3.6.4. For every positive integer m the value of (2m) is a rational multiple of 
? . 
x given by the formula 


(-1 yet (27 j Bam 


2m) = ————. , 
Gm) 2(2m)! (3.30) 
Exercise 3.6.5. Show that 
=] zÉ 
X 6 = 045° (3.57) 


The result of Theorem 3.6.4 was proved by Euler. The corresponding question about 
¢(2m-+-1) was left open and has turned out to be very difficult. Not much is known about the 
values of the zeta function at odd integers. In 1978 R. Apéry showed that ¢(3) is irrational. 
Very recently (2000) T. Rivoal has shown that among the values ¢ (3), €(5), ..., €(2 + 1) 
at least log(#)/3 must be irrational, and that among the nine values ¢ (5), ¢ (7), ..., (21) 
at least one is irrational. W. Zudilin has improved this to show that at least one among the 
four numbers ¢ (5), €(7), ¢(9) and ¢(11) is irrational. These methods do not show which 
of them is irrational. 


3.7 sinx/Xx 


The function sin x /x and the related integral Si(x) defined as 
l * sint 
Si(x) = — dt 
0 I 


appear in several problems. The function sin.x/x is even while Si(x), called the sine inte- 
gral, is odd. Their graphs are shown in Figure 6. 
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(b) Si(x) 
FIGURE 6 


Exercise 3.7.1. Show that the integral 


a 
0 


is divergent. (See the discussion in Exercise 2.2.8.) 


sint 
—|drt 


t 


Exercise 3.7.2. Show that the integral 


(09) 
Í Mars jim f SY mn (3.58) 
0 


is convergent. (Split the integral into two parts 


{+f 


The first one is clearly finite. Integrate the second by parts. Alternately, represent the inte- 
gral as an infinite sum with terms 
(n+l) 
J sint/tdt. 
n 


n 


These terms alternate in sign and decrease in absolute value.) Thus we have an example 
of a function for which the Riemann integral (in the “improper” sense (3.58)) is finite but 
which is not Lebesgue integrable over R. 

The main result of this section is the formula 


[= yao zbo 
5 i a ar (3.59) 


There are several ways to prove this. We give two procis related to our discussion of Fourier 


[ sin ((n + 1/2)r) 
0 


sin (1/2) UA (3:60) 
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for every positive integer n. Let 


l l 
g() =} 1/2 sin(r/2)' 
0 


QO<:r<n7, 


r= 0. 


This is a continuous function (use the L’H6pital rule). Hence by the Riemann—Lebesgue 
Lemma (see Exercises 2.3.4 and 2.3.5) 


WT 
im f g(t) sin((2 + 1/2)r)dr = 0. (3.61) 
aio 0 


From (3.60) and (3.61) it follows that 


T 4 
lim Í sin ((7 + 1/2)1) dt = =N (3.62) 
n= Jo I 2 
Changing variables by putting x = (n + 1/2)r, we get 
(n+1/2)7 o; 
lim l ey (3.63) 
n> JO x 2 


This is the formula (3.59). 


Exercise 3.7.3. The integral 7 in (3.59) can be written as 


c= i — dt 


n=o v1 /2 I 


When n = 2m, put t = mr + x, to get 


(n+1)2/2 sin t n/2 sin x 
/ =t = D" f 
1 0 


wn /2 t mit +x 


When n = 2m — 1, putt = mr — x to get 


a 2 i 
SE a 
an {2 t j men 


_ {2 sinx y —1)” l E A ! sinx dx. 
= j x—mr x+mrī 


m= 3 


Hence 


The integrands in the last series are bounded by the terms of a convergent series. Hence 


m/2 1 < pym ER l I 
r= amy ae x—mn x+mn0 a=, 


m= 


The sum in the braces is 1/ sin x by Exercise 3.4.7. This gives another proof of (3.59). 
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Exercise 3.7.4. Use the Taylor expansion 
x? 2 
3.31" 5.51. 


to calculate Si(zr) using a pocket calculator. You will see that Si(z) = 1.852. 


Exercise 3.7.5. Show that for every real number A, 


2 f(X sindr 
send = — dt 
0 t 


This is an example of an integral representation of a function—the function sgn À is ex- 
pressed as an integral. 


Exercise 3.7.6. Show that 


© sin z cost 14 
— dt = —. 
0 t 4 


Use this to show that 


Exercise 3.7.7. Use the formula sin.x = 2 sin 5 cos repeatedly and show 


sin x ; ae x x 

—— = CoS = -cos—- COS —--- 

x 2 4 8 

This infinite product formula was discovered by Euler. Using the relation cos = 
(1 + cos x)/2 and choosing x = 7/2, obtain from this the formula 


a V2+ v2 y2+v24 v2 
a 2 


ae 


This is called Viére’s product formula. Note that this formula allows us to obtain an ap- 
proximate value of x by repeatedly using four basic operations of arithmetic (addition, 
multiplication, division, and square root extraction) all applied to a single number 2. Use 
a pocket calculator to see what approximate value of z is obtained by taking the first ten 
terms of this product. 


3.8 The Gibbs phenomenon 


We have seen that if f is piecewise C', then its Fourier series converges at each point 
where f is continuous, and at a point of discontinuity the series converges to the average 
value of f at that point. However, in a neighbourhood of a discontinuity the convergence of 
the series is not uniform and the partial sums of the series always overestimate the function 
by about 18%. This is called the Gibbs phenomenon. 
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Consider the function of the Example 3.3.5 and its odd extension having the Fourier 
sine series 


2 3 til. 
— y (-1)"""-sinnrx. 
Se n 


For each N consider the partial sums Sy(f;x) at the points x = 1 — I/N and x = 
—1 + 1/N. We have 


= oes T 
= n/N l 


diea 


This last sum is a Riemann sum for the integral 


™ sint 
— dt 
0 t 
So we have, using Exercise 3.7.4, 
l 2 f7 sint 
im iG I-y)=2 — di > 1.17. 
N T Jo t 


By the same argument one can see that 
lim Sy { f;-1+ 1.17 
i ;-l+—] <-1.17. 
N> -x i N 


The values of f at the points x = 17 and x = —1* are | and —1 respectively. However 
the sums of the Fourier series overshoot these limits. 

If such calculations trouble you, you might find inspiration from the history of the dis- 
covery of the Gibbs phenomenon. 

You will have heard of A. Michelson, one of the greatest experimental physicists and 
an extraordinary designer and builder of equipment to do the experiments. He is known for 
his accurate measurement of the speed of light and for the Michelson—Morley experiments 
to detect ether. He also designed and built a machine to calculate Fourier series. To test 
his machine he fed into it the first 80 Fourier coefficients of the function f we have used 
above. He was surprised that he did not get back the original function but the machine 
seemed to add two little peaks near the discontinuities roughly as shown below. 
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The effect of increasing n was to move these peaks closer and closer to +1 but not to 
diminish their size as Michelson expected. After verifying his observation by hand calcu- 
lations he wrote a letter to the magazine Nature in 1898 expressing his doubts that “a real 
discontinuity [in f] can replace a sum of continuous curves |S} (f: @)].” Gibbs—another 
great physicist who was one of the founders of modern thermodynamics—teplied to the 
letter and clarified the matter. 


Exercise 3.8.1. You can clarify your understanding of uniform convergence by reconciling 
the Gibbs phenomenon with Theorem 2.3.19 on convergence of Fourier series of piecewise 
C! functions. 


Exercise 3.8.2. We have demonstrated the existence of the Gibbs phenomenon for a par- 
ticular function. Show that this must occur near the jumps of any piecewise C! function. 


FIGURE 7 


3.9 Exercises 


The common theme of the exercises in this section is positivity. The numbers an, ba and cn 
in Exercises 3.9.1—3.9.4 are the Fourier coefficients associated with f as in (3.5) and (3.6). 
(The index n runs over all nonnegative integers for a,,, over all positive integers for b,, and 
over all integers for cn.) 


Exercise 3.9.1. Let f(t) > 0. Show that for all n, |en] < co, lan] < ao, and |b,| < ao. 


Exercise 3.9.2. Let f be an odd function such that f(r) > 0 for O < t < x. Show that 
|by| < nb, for all n. 


Exercise 3.9.3. Let f be a monotonically decreasing function on the interval (0, 7). Show 
that b, > 0 for all n. 
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Exercise 3.9.4. Let f be a convex function on (0, 27r). Show thata, > O forn =1,2,.... 
A doubly infinite sequence {c,} of complex numbers is said to be a positive definite 
sequence if 


oe Cr—sirzs = 0 (3.64) 


O<r.s<N-I 


for all positive integers N, and for all complex numbers zo, 21, .--, ZVv—1- This is equiva- 
lent to saying that for every N the N x N matrix 


co oe C2 a) oe 

cI co c 

c2 cI co >e . (3.65) 
CN-| CN—2 co 


is positive (semi) definite. (This matrix has a special form; each of its diagonals is constant. 
Such a matrix is called a Toeplitz matrix.) Clearly, if this matrix is positive definite, then 


Cn Cas co = 0, Icn| < co. 


Exercise 3.9.5. Let f € C(T) and let {c,} be the Fourier coefficients of f. 


(i) If f(t) > 0 show that the sequence {cn} is positive definite. 
(ii) Conversely, suppose {cn} is positive definite. Show that for all N 


Crs (r—s)t > 0. 


O<r.s<N-I 


This implies that the Fejér sums 


5> al) i 
on(fit)= > (1 — 7) cnet (3.66) 


n=-(N-I) 


are nonnegative. Hence, by Fejér’s Theorem (2.2.5), f(r) = 0. 

This statement is a part of a general theorem called Herglotz's Theorem which says that 
every positive definite sequence is the sequence of Fourier coefficients associated with a 
positive measure 4; i.e., 


n . 
Cn = | edit). (3.67) 
-r 


(This can be proved along the lines of Exercise 3.9.5. Given cp, let fa (t) be the sequence 
of functions defined by the expression on the right-hand side of (3.66). Then {fy} is a 
family of nonnegative continuous functions with the property 


l n 
>f fn(t) dt = co. 
2r Jr 
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This is a kind of compactness condition from which we can derive (3.67) using standard 
theorems of Functional Analysis.) 


Exercise 3.9.6. A linear operator A on the space C(T) is called positive if it maps non- 
Negative functions to nonnegative functions. (The elements of C(T) are complex-valued 
continuous functions on T). Let go, g1, g2 be the three functions 


go(t) = 1, g(t) =sint, g(t) = cost. 


Korovkin’s Theorem is the statement: If {A,} is a sequence of positive linear operators on 
C(T) such that asn — œo, 


Angj —> gj uniformly, for j = 0,1,2, 
then 

Anf > f uniformly forall f € C(T). 
A proof of this theorem is sketched below. Fill in the details. 


(i) It is enough to prove the assertion for all real-valued functions f 
(ii) Fix s € T and let g,(r) = sin?[(r — s)/2]. Note that gs(t) = go(r) — gı (s)gı (t) — 
$2(S)g2(t). 
(ili) Let M = sup|f|. Lete > 0, and let 5 be such that | f(t) — f(s)| < © whenever 
|t — s| < 5. Note that gs(1) > 48?/7?, whenever |t — s| > 6. Thus 


M 2 
IFE- f(s)| e+ yr 8l). 


(iv) Put K = Mr?/28?, a constant that depends on f and e. The last inequality can be 
written as 


—€g0 — Kgs < f — f(s)go < £go + Kgs, 


an inequality between functions (in the pointwise sense). Since the operators A, are 
linear and order preserving, this gives 


(An f(t) — f(s)(Ango)(t)| < €(Ango)(t) + K(Angs)(t) (3.68) 


for all z. 


(v) Choose t = s in (3.68) and let n —> oo. Note (Ango)(s) — 1, and by the observation 
in (ii), (Angs)(s) —> 0. The convergence is uniform over s. So from (3.68) we see 
that (An f)(s) > f(s) uniformly. 


Exercise 3.9.7. Use Korovkin’s Theorem to give another proof of Fejér’s Theorem. (Hint: 
The Fejér sums A, f = on (f) define positive operators on C(T).) 
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Exercise 3.9.8. There is a Korovkin Theorem for the space C[a, b] where [a, b] is any in- 
terval. The three functions go, g1. g2 now are g(t) = 1, g(t) = t. g(t) = t°. Formulate 
and prove the assertion in this case. 


3.10 A historical digression 


The series (3.39) is a famous one. The mathematician brothers Jakob and Johann Bernoulli 
had discovered in 1689 a simple argument to show that the harmonic series > l/n is 
divergent. This was contrary to the belief, held earlier, that a series >> Xn with positive 
terms decreasing to zero converges. Among other series they tried to sum was the scries 
$ 1/n? They could see that this series is convergent to a sum less than 2 but did not 
succeed in finding the sum. This problem became famous as the “Basel Problem” after the 
Swiss town Basel where the Bernoullis lived. 

Solving the Basel problem was one of the early triumphs of L. Euler (1707-1783) who 
went on to become one of the most prolific and versatile mathematicians of all time. Euler 
was a student of Jakob and Johann, and a friend of Johann’s sons Daniel and Nicolaus (all 
mathematicians—there were more in the family). It is worthwhile to recall, very briefly, 
some of the stages in Euler's attack on this problem as they are illustrative of a great 
scientist’s working. 

In 1731 Euler proved the formula 


The factors 2” occurring here make the series converge very rapidly. Using this he found 
that 


¢(2) = 1.644934... 


This number did not look familiar. More calculations of this kind followed. The proof of 
(3.39), however, came through another route: Newton's theorem on roots of polynomials 
generalized to “infinite degree polynomials.” 

Let p(x) be a polynomial of degree n and suppose p(0) = 1. Suppose we know the n 
numbers a1, @2, ..., Œn are roots of p. Then we can write 


pay = (1-2) (1-=)..(1-4). (3.69) 
a 2 n 


Euler considered the real function 


a ecg ene ere (3.70) 
xX + 
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noticed f(0) = 1, and f(x) = 0 precisely when x = nz,n € Z. In analogy with (3.69) 
he factored (3.70) as 


He then multiplied out this infinite product to write 


l l l 
Josi- (Arga tga te) tet (3.71) 


Now comparing coefficients of x? in (3.70) and (3.71) he saw that 


l l l 


3l m? n? 


This is the remarkable formula (3.39). The answer confirmed the numerical calculations 
made earlier by Euler and others. 

Several questions arise when one sees such a calculation. Can one do to an infinite 
series whatever one does to a polynomial? One knows all the real roots of f(x), but are 
there other roots? What is the meaning of an infinite product? The function g(x) = e* f (x) 
has the same roots as f(x). Can both be represented by the same formula? 

Euler certainly was aware of all these problems and spent several years resolving them. 
This led to a more rigorous proof of the product expansion (3.33). These days infinite 
product expansions for entire functions (and meromorphic functions) are routinely used 
in analysis. (See the Weierstrass Factorisation Theorem and the Mittag-Leffler Theorem in 
L. V. Ahlfors, Complex Analysis.) 

Euler found great delight in coaxing out of equation (3.71) more and more complicated 
sums. The connection with Bernoulli numbers (introduced by Jakob Bernoulli in his fa- 
mous work Ars Conjectandi) became apparent and he proved a general formula for ¢(2k) 
in terms of these numbers. 

You may enjoy reading two books by W. Dunham. Chapters 8 and 9 of his book Journey 
Through Genius are titled The Bernoullis and the Harmonic Series, and The Extraordinary 
Sums of Leonhard Euler. The other book Euler: The Master of Us Allis a short elementary 
account of some of Euler's work. Chapter 3 of A. Weil, Number Theory: An Approach 
Through History from Hammurapi to Legendre is devoted to Euler. This book by a great 
twentieth century mathematician is an excellent historical introduction to a substantial part 
of mathematics. 

The proof of (3.39) that we have given is one of several known now. Like Euler's proof 
this uses a general method that leads to several other formulas. A more special proof given 
by Euler is outlined in the following exercise: 
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Exercise 3.10.1. 


(1) Show that 


(ii) Use the integral 


Vv 
sin! x =| dr)! at 
0 


to expand sin! x in a power series. Substitute this in the integral in (i) and integrate 


term by term. Use the recurrence relation 


[pat n+l | 1" 
—— dt = — —— ít 
o vli-=-r n+2Jo Vl-r? 


l 
t 
Í = dt = 1. 
o vl-r 


(iii) The result of this calculation is a power series expansion for the function 4(sin~! x)’. 
Put x = | in this formula to obtain the sum (3.38). 


starting with 


Exercise 3.10.2. Show that 


(Hint: Use the power series for (sin~! x)*. ] 


One of the reasons for interest in the zeta function is the intimate connection it has with 
prime numbers. 


Exercise 3.10.3. Fors > 1, let 


oo 


Show that 


where, in the product on the right, p varies over all prime numbers. Among other things 
this shows that there are infinitely many prime numbers. This formula was discovered by 


Euler. 
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Let us demonstrate an interesting application of it that links prime factors, probability, 
and the number z. A naive and intuitive idea of probability is adequate for our discussion. 

A natural number picked “at random” is as likely to be even as odd. We express this by 
saying that the probability of a natural number being even (or odd) is 1/2. In the same way, 
the probability of a natural number picked at random being a multiple of k is 1/k (as such 
multiples occur at jumps of length k in the sequence of natural numbers). 

Pick up a natural number n at random and factor it into primes. What is the probability 
that no prime is repeated in this factoring? This happens if n is not a multiple of p? for 
any prime p. As we have seen, the probability of this for any given prime p is 1 — 1/p°. 
The probability of all these “events” happening simultaneously is the product of these 
individual probabilities, i.e., [ [ a= p°). We have seen that this product is equal to 


Exercise 3.10.4. Think of a plausible argument that shows that the probability that two 
natural numbers picked at random are coprime is 6/77. Generalise this statement to k 
numbers. 


The formulas of Viéte and Wallis (Exercises 3.7.7 and 3.5.3) were discovered in 1593 
and 1655, respectively. Thus they preceded the work of Euler (1707-1783). Of course, the 
arguments of Viète and Wallis were different from the ones given here. Since both formulas 
give expressions for 2/7, one may wonder whether there is a single expression that unites 
them. There is one, and it was found quite recently. The curious reader should see the 
paper T. Osler, The union of Viéta’s and Wallis’s product for x, American Mathematical 
Monthly, Volume 106. October, 1999, pp. 774-776. 

A final tidbit. The symbol z seems to have been first used by William Jones in 1706. 
For thirty years it was not used again till Euler used it in a treatise in 1736. It won general 
acceptance when Euler used it again in his famous book Introduction to the Analysis of the 
Infinite published in 1748. There are a few books devoted exclusively to the number x. A 
recent one is J. Arndt and C. Haenel, x Unleashed, Springer, 2001. 


Convergence in Ly and L, 


In Chapter 2 we saw that the Fourier series of a continuous function on T may not con- 
verge at every point. But under weaker notions of convergence (like Cesaro convergence) 
the series does converge. Another notion of convergence is that of convergence in the mean 
square or L2 convergence. However, this notion is in some sense even more natural than 
pointwise convergence for Fourier series. We will now study this and the related Lı con- 
vergence. We assume that the reader is familiar with basic properties of Hilbert space and 
the spaces Lı and L2. Some of them are quickly recalled below in the form of exercises. 


4.1 L convergence of Fourier series 


Let H be a Hilbert space with inner product (...) and norm || |l. Special examples of 
interest to us are: 


1. The space /2 of all sequences of complex numbers x = (x1. x2. ...) such that 


2 
> lial? < 00. 
The inner product in this space is defined as 
oO 


(x.y) = X nfn 


n=l 
and the associated norm is 


o 1/2 
? 
ixi2= {9 ra) ; 


n=l 
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We need also the space of doubly infinite sequences {xn }Pe o Satisfying 


(as 


ae 
> bul? <o. 


non XN 


We denote this space by /2(Z). It is easy to see that [2 and /2(Z) are isomorphic Hilbert 
spaces. 

2. For any bounded interval / on the real line, the space L2(/) consists of all Lebesgue 
measurable functions f on 7 such that f, |f |? < 00. The inner product on this space is 
defined as 

l 


(fg) = 77 


/ f(x) g(x) dx, 
I 


where |7] denotes the length of 7. The associated norm is 


l dias 1/2 
Ile = (= | FOO! ix) | 


(The factor 1 /|/| is inserted to make some calculations simpler.) 
3. The space L2(R) consists of all Lebesgue measurable functions on the real line R such 
that Je | fI? < co. Here the inner product and the norm are given as 


(f.g) = [ f(xyg(x) dx. 


1/2 
fila = (f. for ax) 


Of course, when we talk of measurable functions, we identify functions that are equal 
almost everywhere. 

The space L2[—z., 2] can be identified with L2(7T). 

We are interested also in the space L;(/) which consists of all integrable functions 
on J, i.e., 


Lı) = ly : | iflas < oo} 
I 
When / is a bounded interval, we define, for f € Li(/). 


l 
Ifl = gf oa. 


For f in the space Lı (R) we define 


Ifl = f, IFO ldx. 


The spaces Lı(7) and Lı(R) are Banach spaces with this norm. Neither of them is 
a Hilbert space. (You can prove this by showing that the norm does not satisfy the 
“parallelogram law” which a Hilbert space norm must satisfy). 
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Exercise 4.1.1. Show that the norm and the inner product in any Hilbert space satisfy the 
Cauchy-Schwarz inequality: 


Ix.» < Hei ily 
Exercise 4.1.2. Use this inequality to show that for every bounded interval /, 
L271) C Lil). 


Show that this inclusion is proper. 
Exercise 4.1.3. Show that neither of L2(R) and L (R) is contained in the other. 


Exercise 4.1.4. Show that continuous functions are a dense subset of L2 and of L4. Func- 
tions of class C™ also are dense in Lə and in Ly. 

Recall that a sequence {e,} in a Hilbert space H is called orthogonal if (en, €m) = 0 for 
n Æ m, and orthonormal if in addition |je„ || = 1. Given any vector x in H let (x, en} = an. 
The numbers an are called the Fourier coefficients of x with respect to the orthonormal 
system {en}. 


Exercise 4.1.5. Show that in the Hilbert space L2(T) the sequence e,, defined as 
n(x) = ef, nez, 


is an orthonormal sequence. Note that here the Fourier coefficients are 


n 


l ee re 
(f. en) = on fxe dx = fín). 


So the general results on orthonormal sets in Hilbert spaces are applicable here. 


Exercise 4.1.6. (Bessel’s inequality) Prove that if {e,} is any orthonormal system in a 
Hilbert space H and a, the Fourier coefficients of a vector x with respect to this system, 
then 


? ? 
X lan? < UIP. 
n 


Therefore, the sequence {an} belongs to the space l2. For f € L2(T) this gives 


PÊ? < IFIP. 


Exercise 4.1.7. Let a, be the Fourier coefficients of a vector x with respect to an orthonor- 
mal system {e,}. Let b, be any other sequence of numbers. Show that 


N N 
vv X anen X= X bren 
n=] n=l 


= 
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for all integers N. Further, this inequality is an equality if and only if a, = bn for all 
Wee eee N. For the space L2(T) this means that among all trigonometric polynomials 
of degree N. the partial sum Sy(f) is the closest approximation to a given function f in 
the norm of L3(T). 

An orthonormal system {e,} in a Hilbert space H is called complete if finite linear 
combinations of {e,} are dense in H, i.e., given x € H and e > 0 there exists an integer N 
and numbers aj .... a'y Such that 


LE. 


N 
p 1 
X— ? apen 
n=l 


Note that, by Exercise 4.1.7, the best choice for such numbers, if they exist, is the Fourier 
coefficients a,. A complete orthonormal system is called a basis for H. The space H is 
separable if and only if it has a countable basis. 


Exercise 4.1.8. (Plancherel’s Theorem) Show that an orthonormal system {en} is a basis 
in H if and only if the Fourier coefficients a, of every vector x with respect to én satisfy 


the equality 
? ? 
X lan? = ix., 
n 
i.e., Bessel’s inequality becomes an equality. 
Theorem 4.1.9. The system e,(x) =e!" is a basis for Lə(T). 


Proof Let f € L2(T). By Exercise 4.1.4, for each e > 0, there exists g € C! (T) such 
that || f — gll2 < £. By Dirichlet’s Theorem there exists an N such that 


‘ți 


supje(x)— Sn(2; x)| < 


Denote Sy (8: x) by Sy. Then 


l 7 5 1/2 £ 
lig — Swll2 = È L Ig(x) — Sn (2: x)| as| s3 
Hence 
lf — Swil2 < €. 
But Sy is a lincar combination of the functions e,,. | 


Exercise 4.1.10. Show that for f € L2(T), 


N a 
f- Yo fimen 


n=—N 


=.(. 


2 


lim 
N=>x 


Ifls= >> fwP 


n=-OO 
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Thus the Fourier series $` f (n)e'"* converges to f in the sense of convergence with respect 
to the norm of L2(T). In particular, this is true for all continuous functions on T. This 
explains our remark at the beginning of the chapter. 


Exercise 4.1.11. Let {an} be any sequence in l2. Let H be a Hilbert space with an or- 
thonormal basis {e,}. Show that there exists a vector x in H whose Fourier coefficients 
with respect to én are an. Hint: Show that the series Y` ane, converges in H. 

In particular, given any sequence {an}°2 o in /2(Z) we can find a function f in L2(T) 
such that 


f(n) = fhi: 


Exercise 4.1.12. (Riesz-Fischer Theorem) Show that the spaces L2(T) and [> are iso- 
morphic: the map that sends an element f of L2(7) to the sequence consisting of its 
Fourier coefficients is an isomorphism. (This is a very important fact useful in several con- 
texts. For example, in Quantum Mechanics the equivalence between the “Wave Mechan- 
ics” and the “Matrix Mechanics” approaches is based on this fact. See the classic book, 
J. von Neumann, Mathematical Foundations of Quantum Mechanics.) 


Exercise 4.1.13. (Parseval’s Relations) Show that if f. g € L2(T), then 


i i BO ws dae 
— | f(gidx= } fmm. 
bagi 


2n n=—-OO 


Prove a general version of this for any Hilbert space. 


Exercise 4.1.14. Use the Weierstrass approximation theorem (Exercise 3.1.4) and Exer- 
cise 4.1.4 to show that the polynomial functions are dense in the Hilbert space L2[—1, 1]. 
Note that a polynomial is a finite linear combination of the functions x", > 0. Obtain 
an orthonormal basis of L2[—1, 1] by applying the familiar Gram-Schmidt process to the 
functions x”. The functions you get as a result are, up to constant multiples, 


Po(x) = 1, 

P\(x) =x, 
Pula) = ox? == 

UX) = -X =>, 

RS bod) 

5 3 

P3(x) = si = ar 
P(x) E 2x? = 1)" 
WX) = Saal axe 


These are called the Legendre Polynomials. Every function in L2[—1. 1] can be expanded 
with respect to the basis formed by these functions. This is called the Fourier—-Legendre 
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series. (There are several other orthonormal systems for the space L2 that are useful in the 
study of differential equations of physics). 


Exercise 4.1.15. Let {e,} be an orthonormal system in a Hilbert space H. Show that the 
following conditions are equivalent: 


(i) {en} is a basis, 
(ii) if x € H is such that (x, e,) = 0 for all n, then x = 0, 
(iti) Ixl? = Fix, en)? for all x € H. 


These results are very useful in different contexts. Here are some examples. 


Exercise 4.1.16. Let f € C'(T). Recall that then in f (n) = fi(n). (See Exercise 2.3.11). 
Use this and the Cauchy—Schwarz and the Bessel inequalities to show that, for0 < N < 
N' < œ, 


ISN (f: 0) -—Sw(fiOls $” IfI 


In|> N 
l 
=> fo 
|Jn|>N In| 
C 
< TALL 


This shows that Sy (f; 8) converges to f (0) uniformly at the rate 1/N !/? as N —> oo. 
By the same argument, show that if f € C*(T), then Sy(f;@) converges to f(0) 
uniformly at the rate 1/N4~!/2, 


Exercise 4.1.17. In Exercise 2.3.12 we saw that if f € C*(T), then f(n) = O(1/n). 
Show that if f € Lı(T) and f(n) = O(1/n*) for some integer k > 2, then fisk-—2 
times continuously differentiable. Show that no more can be concluded. 

Hint: $ f (n)ine™* converges uniformly. 


Exercise 4.1.18. A sequence {xn} o is called rapidly decreasing if |n|‘x, converges 
to zero as |n| — oo, for all k > 0. Construct an example of such a sequence. Show that 
f € C™(T) if and only if the sequence f(n) is rapidly decreasing. 


Exercise 4.1.19. Let f have the Fourier series 


20 
ao . 
3 + ) (an cosnO + by sinn@). 


n=l 


(See (3.5) in Chapter 3). Show that 


1 7 n a Scapa : 
-| iff =24+ > (a +03). 
fe di 2 n=l 


Derive a corresponding result when f is a function with an arbitrary period. 
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Exercise 4.1.20. Use this version of Plancherel’s Theorem to prove 


Hint: Consider the Fourier series of the function in Example 3.3.5. 


Exercise 4.1.21. Derive more formulas of this kind by applying Plancherel’s Theorem to 
functions studied in Section 3.3. 


Exercise 4.1.22. Let f be a C! function on (0. z] with f (0) = f(r) = 0. Show that 


| "ite < Í f'e 


By a change of variables, show that if f is a C! function on any interval [a, b] with f(a) = 


f(b) = 0, then 
b 2 b 
4 (b-a) 1? 
f eS fire 
a m- a 


This is called Wirtinger’s inequality. 
Show that these inequalities are sharp. Hint: Let f(x) = sin x. 


4.2 Fourier coefficients of L4 functions 


The Fourier coefficients 


n 


f(n) = ok, f(tye™ dt 
2r J-a 
are defined whenever the integral on the right-hand side makes sense. This is so whenever 
f € L\(T). The spaces C(T) and L2(T) we have considered earlier are subspaces of 
L\(T). For L2(T) we have obtained a complete characterization of the Fourier coefficients: 
we know that f € L2(T) iff the sequence f (n) is in l2, and further the map taking f to the 
sequence {f(n)} is an isomorphism of Hilbert spaces. For L4 (T) the situation is far less 
satisfactory, as we will see in this section. One of the more attractive features of L1(T) 
is that it is a “convolution algebra” and there is a very neat theorem relating the Fourier 
coefficients of f x g with those of f and g. Many of our results for Lj can be deduced 
from the ones we have already derived for continuous functions. 
For f € C(T) define 


If lloo = sup f(D. 
teT 


Then note 


1 Pig 
Ifl => J IFC lat < I fllo: (4.1) 
LN Jr 
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Soif fa — f inthe space C(T), i.e.. if the sequence fy of continuous functions converges 


uniformly to f, then fy > f in L\(T) also, i.e., [fn — fili 2 0. 
For f, € Lı(T) define. as before. 


n 


(f *xg)(t)= f(t —x)g(x) dx. 
-r 


A routine argument using Fubini’s Theorem shows that f * g is well defined for almost all 
t, and is in L\(7). It is perhaps worthwhile to go through this argument in detail, though it 
is Somewhat dull. 

Let 7, J be any two (finite or infinite) intervals and tet J x J be their product. The 
theorems of Fubini and Tonnelli relate the double integral of a measurable function f(x. y) 
with respect to the product measure on / x J to iterated one-variable integrals. 


Fubini’s Theorem. Let f € L\(/ x J), ie., let 


I Lf(x, y)|dxdy < oo. 
IxJ 


Then for almost all x € 1, 


J If (x. y)dy < o0, 
J 


i.e., the function f(y) = f(x, y) is an integrable function of y for almost all x. Further, 


the function 
J f(x. y)dy 
J 
is an integrable function of x, and 


J f(x, y)dxdy = J p f(x. ndy| dx. 
IxJ I J 


A corresponding statement with the roles of x and y interchanged is true. 


Tonelli’s Theorem. Let f be a nonnegative measurable function on I x J. If one of the 


integrals 
[lf pes. ay] dx, 
ILJI 
Ap) fe. yds |as 
JU 


is finite, then so is the other, and f € L\(1 x J). 
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Hence (by Fubini’s Theorem) 


| fos. nasdy = [| | fos. nay|as 
IxJ ILJI 
= f | f epas |as- 
JLJI 


(Fubini’s Theorem says that if f(x, y) is an integrable function on J x J. then its 
integral can be evaluated in either of the three ways—as an integral with respect to the area 
measure or as an iterated integral in two different ways. Tonelli’s Theorem says that if f 
is nonnegative, then even the hypothesis of integrability is unnecessary. The three integrals 
are either all finite or all infinite.) 

Let us return to convolutions now. 


Theorem 4.2.1. Let f, g, € L\(T). Then the integral defining (f * g)(t) exists absolutely 
for almost all t, isin L\(T), and 


If gli < 27K filigi. (4.2) 


Proof Since f is a periodic function, 


J fe -anide= | IfOldt = 2x ifii 


forall x e T. Hence 


x 


Ww 
J Ift —x)g(x)| dt = |g(x)| [f(t —x)| dt = |g(x) [271 f lh. 
-0 


-x 


and therefore, 


[ f [f(t nga] as =4n7 If ll gil. 


-xn =T 
So, by Tonelli’s theorem f(t — x)g(x) is an integrable function on the rectangle T x T. 
By Fubini’s theorem 


rrd 
(f *g)(t) = f(t —x)g(x) dx 
baa i 


is well defined for almost all t. We could put an arbitrary value 0 for f *g at the exceptional 
set where it may not be defined. Now note that 


n 


2r iif * gli =f K(f *gXÐidt 
=f f(t —x)g(x) dx} dt =) J [f(t — x)e(x)| dxdt 
al, sonf f fa = odr as 


= 4r’ li filigi m 


88 FOURIER SERIES 


An immediate application of this is: 


Theorem 4.2.2. Let f € Li(T) and let on( f) be the Cesaro sums of the Fourier series 
of f. Then 


lim If —on(f ih = 0, 
n> 


i.e., the Fourier series of f is Cesàro summable to f in L\ norm. 


Proof Continuous functions are dense in Lı (T). So given € > 0 there exists a continuous 
function g such that || f — gllı < £. If Fa denotes the Fejér kernel, defined by (2.8), then 
by Theorem 2.2.5 and the inequality (4.1) there exists N such that |g — g * Falļlı < € for 
alla > N. Hence, we have, 


If — f Fali < Wf gli + lle — g * Falli + Ig * Fn — f * Falli 
< 2e + Il(g — f) * Falli. 


But, by Theorem 4.2.1, 


ie — f) * Falla < 27lle — fila WFalli < 27 €. 
So 


If —f* Falı <20+7)e foralln > N. P| 


Corollary 4.2.3. (The Riemann—-Lebesgue Lemma) Jf f € L(T), then 


lim f(n) =0. 
|n]—> co 
Proof Use Theorem 4.2.2 and the idea of the proof of Theorem 2.3.1. a 


Let co denote the space of sequences converging to 0. The Riemann—Lebesgue Lemma 
says that the map f — {f(n)} is a map from L\(T) into co. From results on continuous 
functions obtained earlier, we know that this map is one-to-one. This map has a particularly 
pleasing behaviour towards convolutions: 


Theorem 4.2.4. Let f and g be in L\(T). Then 


(f * 2)(n) =2n f(n)a(n) foralln. 
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Proof Once again, using Fubini's Theorem we can write 
— l : 
(f * g)(n) = 3n fo x g)(t)e ™ dt 
l : 
= JI f(t — x)ge(xje ™ dt dx 
l —in(t—x) —inx 
EF f(t —x)e “g(xje™ dt dx 


l : ; 
g | ro di f seeda 
= 2n f(n)ĝ(n). 


(All integrals above are over the interval [—7, 7r].) | 
Remark. Some books define f x g with a different normalisation as 
1 n 
(f *8)(t)= Pa f(t —x)g9(x) dx. 
2r Jr 
With this definition you will get 
(F= 8n) = fin) 
and 
lf * gil < fillet. 


A vector space X is called an algebra if its elements (x, y, z. etc.) can be multiplied 
and the product x * y obeys the relations 
xe(yerpH(vey)es, 


(ax)*y =a(xey) forall scalars a. 
Suppose X is a Banach space with norm |.||. If a product on X satisfies the inequality 
lx e xil < laiilyll forall x. y, 


we say X is a Banach algebra. 


The space C(T) (with f + g and fg defined as usual) is a Banach algebra with the 
supremum norm. The space M (n) of n x n matrices is a Banach algebra with the norm 
of A defined as |jA|| = sup{||Au|| : u € C”. llul = 1). The multiplication in C(T) is 
commutative, that in M(n) is not. Our discussion shows that L;(7) is a Banach algebra 
with multiplication of f and g defined by convolution f * g (defined in such a way that 


lf gli < Ifeli). 
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Exercise 4.2.5. 


(i) Show that there does not exist any function f in Lı(T) such that f * g = g for all 
geéeLy(T). 
(ii) Show that there does not exist any continuous function f € C(T) such that f +g = g 
for all g € C(T). 
(iii) Let f € Lı(T) and g € C*(T). Show that f x g is in C*(T), and its kth derivative is 
(f xg) = f x 9). 


Thus neither the space of continuous functions, nor the space of integrable functions has 
an identity with respect to convolution. (The constant function | is an identity for C(7) 
with the usual multiplication, the identity matrix is an identity for M(n).) 

We have seen that if f € L2(T), then f(n) not only goes to zero as |n| —> 00, but is 
Square summable. However, for f € Lı(T) nothing more than f(n) —> Ocan be said in 
general. This is proved in Theorem 4.2.10 below. 


Exercise 4.2.6. Let f be absolutely continuous and let f’ € L2(T). Show that 


Se oa R 1 
$O Âm < IFO + 1f 
n=—00 V3 

[Hint: Use the Cauchy-Schwarz Inequality. ] 

Note that in particular this implies that f (n) is in lı (Z). 

Let {an} Poo be a sequence of real numbers. Let Ady = Qn41 — Qn. A?an = A(Aa,) = 
An+2 — 2an+1 + an. Note that {an} is monotonically increasing if and only if Aa, > 0 for 
all n. 


Definition 4.2.7. The sequence {an} is said to be convex if A*a, > 0 for all n. 


Proposition 4.2.8. Suppose the sequence {ay}, is convex and bounded. Then 


(i) {an} is monotonically decreasing and convergent, 
(ii) limn Aa, = 0, 
Gii) Eoln + 1)Aa, = ao — liman. 


Proof If Aa, > 0 for any n, then by the given convexity, Aam > Aa, > 0 for all m > n. 
But then {an} cannot be bounded. So Aa, < 0 for all n. This proves (i). Note that 


n 
> Aak = An+l ani ag. 
k=0 


Thus the series }`(— Aap) is convergent and its terms are positive and decreasing. This 
proves (ii). We have 


N 


Xn + 1)Aĉ°a, = a9 — an+ + (N + 1)Aayn+i. 
n=0 


This proves (iii). E 
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Theorem 4.2.9. Let {an ke- be a sequence such that 
(i) an > O for all n, 
(ii) an = a-n, 
(ili) an > Oas n > oo, 


(iv) {an} p2 


n=0 IS CONVEX. 


Then there exists a nonnegative function f € L\(T) such that an = f(n) for all n. 


Proof Let F, be the Fejér kernel and 


(20) 
f(t) =2n yom + WA7 Gy Fag (t). 
n=0 


Since || Fy || = 1/2z for all n, this series converges in Lı. So f € L;(T). Note that 
f(t) = 0 since all the terms involved are positive. For each integer k, we have 


~ 
fk) = 20 Y (n + 1) 7 ay Fr gh). 


n=0 
Since 
i AN 
Fra) => È (: = HL) in 
j=-n 

we have 

miyos Wert meiss 
Hence 

E 5 Iki 
f(k) = ds (n + l)A an (1 — a) = ayy. a 


n=|A| 


Exercise 4.2.10. There exists a sequence of nonnegative real numbers that is convex and 
converges to zero more slowly than any given sequence; i.e., if {by} is any sequence con- 
verging to zero, then there exists a convex sequence {an} such that |by| < an and a, —> O. 
(Hint: Think of functions instead of sequences. ] 


We have shown above that a sequence of nonnegative real numbers can be the sequence 
of coefficients of a Fourier cosine series and converge to zero at any rate. The situation is 
different for a sine series: 


Theorem 4.2.11. Let f € L\(T) and let 


(i) f(n) > Oforalln > 0, 
(ii) f(n) — — f (=n) for all n. 


92 FOURIER SERIES 


Then 
im 
$- fin) < 00 
nao 
Proof Let 
x 
F(x) = fdt, -N LIXIN. 
-r 


Then F is absolutely continuous and F’ = f, a.e. Hence 
a 1 a 
F(n) = — f(n) foralln 40. 
in 


Now apply Theorem 2.2.5 to the function F at the point 0 = 0 to get 


x N n fin) 
p= 1 2 — ye 
ES O H ena Z ( N+ :) in 


So 


: ud n fn) i š 
im (1- ) : =5(F@-FO). 


Thus the series }* f (n)/n is Cesaro summable; and since its terms are nonnegative it must 
be convergent. a 


Corollary 4.2.12. Ifa, are nonnegative real numbers and if 


fore) 
An 

) — = OO, 
n 


n=l 


then the series $72 ay sinnt cannot be the Fourier series of any function in Li (T). 


Exercise 4.2.13. Show that the series 


© cosnt 


“> logn 


is the Fourier series of some function in Lı(T), but the series 


© sinnt 


logn 


n=? 


cannot be the Fourier series of any function in Lı (T). 


So, what can be said about the class A of all sequences which are Fourier coefficients 
of functions in Lı (T)? We have shown the following: 
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(i) A C co, the space of doubly infinite sequences going to zero at +00, 
(ii) A Æ co, 
(iii) A is an algebra. i.e., it is closed under addition and (pointwise) multiplication because 
of the relations: 
(f+ g)(n) = fin) + &(n), 
(f *g)(n) = 2r f (n)g(n). 


However, a complete description of the class A is not known. (In fact, it is believed that 
there is no good description of A). 


Some Applications 


One test of the depth of a mathematical theory is the variety of its applications. We began 
this study with a problem of heat conduction. The solution of this problem by Fourier 
series gives rise to an elegant mathematical theory with several applications in diverse 
areas. We have already seen some of them. We have proved the Weierstrass approximation 
theorem in Chapters 1 and 3. This is a fundamental theorem useful in numerical analysis, 
in approximation theory and in other branches of analysis. In Chapter 3 and 4 the Dirichlet 
and Plancherel theorems were used to obtain the sums of some Series and the values of 
some integrals. Some more applications of Fourier series are described below. 


5.1 An ergodic theorem and number theory 


The ergodic principle in statistical mechanics states the following: the time average of 
a mechanical quantity should be the same as its phase average. Rather than explain the 
general principle we will find it instructive to see how it operates in a special situation. The 
model we describe is due to H. Weyl. 

Consider the circle T = [—7. x). Let gy € (—x, 1) and define a map Ry : T —> T by 


Ry(@) = @ + gy mod 2r. (5.1) 


If T is thought of as the unit circle in the plane, then Ry is a rotation by angle ọ. We think 
of T as the phase space and the action of Ry as dynamics on this space. If @ = 6o is a given 
point on T, then its trajectory under this dynamics is the succession of points 


Oo = 6, 
6 =R,@=O0+g  mod2z, 
6) = R26 =0 +2% mod2nz, 


Ok = REO =6+kg mod2z. 
95 
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Any continuous function f on T is thought of as a mechanical quantity. The time average 
of f is defined as 


l N-I 
im — . 5.2 
dim = 2 f (x), (5.2) 


and its phase average is defined as 


1 n 


=E f(0) dé. (5.3) 
2n au 


=~ 


One can think of 6) moving to 6, 62,... at successive time intervals. The sum in (5.2) 
then gives the average value of f on the trajectory of f from time 0 to N. The integral 
(5.3), on the other hand, gives the average value of f over the phase space 7. 

An example of the ergodic principle is: 


Theorem 5.1.1. (Weyl) If is an irrational multiple of 27, then the quantities (5.2) and 
(5.3) are equal. 


Proof Given a continuous function f write Wy (f) for the difference between (5.2) and 
(5.3): 


iS 1 f7 
WND = SO- | f(0) a0. 
k=0 Si =n 


We want to show Wy (f) —> Oas N —> œ. The idea of the proof is to do this first for the 
functions e„(0) = e!"®, then for trigonometric polynomials and then by Fejér’s Theorem 
for any continuous function f. 

When n = 0, e„ (0) = 1; and for f = 1 both (5.2) and (5.3) are equal to 1. So, in this 
case Wy = 0 for all N. 

When n Æ 0 we can write 


Ls pe: E Pe 2 
[Ww (en)| = Wo ee J e™"° dO 


k=0 =p. 


ind N-l 


x 2 einke 


k 


ein 1 — eitNe 


N \|—eine 


"| 
SS Fe a E 
= N |l- er} 


Note that e!”? + | since g is an irrational multiple of 277. As N —> œ, the right-hand side 
of the inequality above goes to 0. 
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Now note that both (5.2) and (5.3) are linear functions of f. So 
Wv(p) 270 a N> œ, 


whenever p is an exponential polynomial. 
This linearity also shows that if f and g are continuous functions on T such that 


sup |f (8) — g(@)| < e, 


then 


Wa (f) = Wn (g)| <2e, forall N. 


Now use Fejér’s Theorem to complete the proof. a 


Exercise 5.1.2. Show that if g is a rational multiple of 277, then (5.2) and (5.3) are not 
always equal. 


A remarkable consequence of Theorem 5.1.1 is Weyl’s Equidistribution Theorem in 
number theory. Let x denote the fractional part of a real number x, i.e.,0 < x < 1 andx—-—Xx 
is an integer. Weyl’s equidistribution theorem says that if x is irrational, then for large N 
the fractional parts of x, 2x, ..., Nx are uniformly distributed over (0, 1). A precise state- 
ment is: 


Theorem 5.1.3. (Weyl) [fx is an irrational number, then for every subinterval [a,b] of 
(0, 1), 


l me 
lim —card{k:1 <k <WN, (kx) € [a, b]} =b-—-a. (5.4) 
N-co N 


Here card A denotes the cardinality of a set A, and (kx)~ is the fractional part of the 
number kx. 


Proof By a simple change of variables the statement (5.4) is reduced to an equivalent 
statement: if x € T and is an irrational multiple of 27r, then for every subinterval [a, b] of 
(=x, 7), 


l = 
lim —card{k: 1 < k < N, (kx) € [a, b]} = (5.5) 
N=œ N 


Bow 


Of course, here kx is again thought of as an element of T for all k. 
We will prove (5.5) by applying Theorem 5.1.1. Let Xfa,b} denote the characteristic 
function of [a, b], i.e., 


1 ift € [a,b], 
0 otherwise. 


Xap] (1) = | 
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This is a discontinuous function. Given £ > 0 we can choose two functions f+ and f- 
which are continuous and approximate Xfa.b] from inside and outside to within e, i.e., 


0 < f(t) < Xab (t) < (<1 forallt (5.6) 
and 
n m 
(b—a)—e < f- dt < f+(t)dt < (b—a) +E. (5.7) 
-n -7 
Note that (5.6) implies 
N N 
YO f- (kx) < card{k : 1 < k < N, (kx)™ € la, bI} < È f+ (6). (5.8) 
k=] k=1 


By Theorem 5.1.1, there exists No such that for all N > No, 


<E. (5.9) 


N | f" 

Ky ™, a eeen saa aes d 
2 fs ((kx)~) 7 i fat) dt 
Now use (5.7), (5.8) and (5.9) to obtain (5.5). E 


Notice that we have interpreted the process of picking up the fractional parts of 
X, 2x, 3x... . as a “dynamical process.” 


Exercise 5.1.4. Show that the statement of Theorem 5.1.3 is not true when x is a rational 
number. 


5.2 The isoperimetric problem 


Among all simple closed plane curves with a given perimeter, which one encloses the 
maximum area? (Here a “simple” curve means a curve that does not intersect itself.) This 
is called the isoperimetric problem. The Greek founders of geometry proved that a circle of 
perimeter L always encloses a larger area than any polygon with the same perimeter. This 
result is attributed to Zenodorus (famous for “Zeno’s paradox”). In 1841 Steiner proved that 
among all simple closed plane curves with perimeter L. the circle encloses the maximum 
area. A very elegant proof of this fact using Fourier series was given by Hurwitz. We will 
give this proof here under the additional assumption that all curves that we consider are 
(piecewise) C!. 

Let C be any curve in the plane parametrised over [—z, x], i.e., C is the range of a 
continuous map (x(t), y(t)) from [—z, 77] to R?. You can think of C as the trajectory of a 
particle moving in the plane from time —z to x. We assume that the curve is 


(i) closed, i.e.. (v(—7), ¥(—77)) = (x(77), y(7}), 


(ii) simple, 1.e., if -x <s <t <a then (x(s), y(s)) Æ (x(t), ¥(t)), 
(iii) smooth, i.e., x(t) and y(t) both are C! functions, 
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(iv) of length L, i.e., 


(x(t)? + yD] at = L. 


-xn 
It is convenient to choose the parametrisation in such a way that 


? 


Bete L 
(x"(t))? + O = —. 
4r“ 


In the picture of the moving particle this means that the particle moves with uniform speed 


while tracing the curve C. This involves no loss of generality in our problem. 
If A is the area enclosed by such a curve, then 


(5.10) 


A =f x(t)y(t)dt. (5.11) 


-70 
Integrate (5.10) over [—7r, 7] and use Plancherel’s Theorem (Exercise 4.1.10). This gives 
L? 


l j ? 1 2 
r | LD + OAY] dt 


= ? 
= ÑO PHD 


n=—CO 


oo 


= > PRM? ISMI’) (5.12) 


n=—00 


by Exercise 2.3.11. 
Now note that, since x(t) and y(t) both are real functions, (n) and f(n) are complex 
conjugates of <(—n) and §(—n) respectively. So (5.12) can be written as 


[oe] 
L? =8n’ yon? (en)? + 1m1). (5.13) 


n=l 


Similarly, using Parseval’s relations (Exercise 4.1.13) we get from (5.11) 


co —_—_——_————_ 
A=2n X(n)(9"(n)) 


n=-00 


[2.9] 


= —2ri > nè (Sn) 


n=—09 


=4n ð n Im(%(n)9(n)). (5.14) 


n=l 


Here Im denotes the imaginary part and the bar denotes complex conjugation. 
From (5.13) and (5.14) we get 


0° — 
L? — 4n A = 8n" Pin? +10) — 2n Im Fn) H(n)}. (5.15) 


n=] 
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Now if 8(72) = a + iB, and Ẹ(n) = yn + iôn are the respective real-imaginary decompo- 
sitions, then the nth term of (5.15) can be written as 


n°? + B2 + y? +62) — 2n(BaYn — Ondn) 
= (n? — 1)(a2 + B2) + (in + nôn)? + (Bn — nyn, 
and this is nonnegative for each n. Hence from (5.15) we get 
L? > 47A 
and equality holds here if and only if 
On = Bn = yn =n =O forn > 2, 
a =ô, Sy. 
Hence, we have L? = 4r A if and only if 
x(t) = (0) + 2(œ; cost — fı sint), 
y(t) = 9(0) + 2(ßı cost +a sint), 
or equivalently, if and only if 
(x(t) — 8(0))* + (9) — $Y? = 4(aq + BF) forall r. 


This means that the curve C is a circle. 

We have proved that among all smooth simple closed curves in the plane with a given 
perimeter, the circle encloses the maximum area. With a little work the condition of 
smoothness can be dropped. You can try proving this by assuming the following: if C 
is a rectifiable simple closed curve in the plane with perimeter L and enclosed area A, 
then there exists a sequence of smooth simple closed curves C,, such that C, converges 
uniformly to C; further if L, and A, are, respectively, the perimeter of C, and the area 
enclosed by C,,, then Ln —> L and A, > A. 

The isoperimetric problem is believed to be the first extremal problem discussed in the 
scientific literature. It is also known as Dido’s Problem. The epic poem Aeneid by the 
poet Vergil of ancient Rome tells a legend: Fleeing from persecution by her brother, the 
Phoenician princess Dido set off westward along the Mediterranean shore in search of a 
haven. A certain spot on the coast of what is now the bay of Tunis caught her fancy. Dido 
negotiated the sale of land with the local leader, Yarb. She asked for very little—as much as 
could be “encircled with a bull's hide.” Dido managed to persuade Yarb, and a deal was 
struck. Dido then cut a bull's hide into narrow strips, tied them together, and enclosed a 
large tract of land. On this land she built a fortress and, near it, the city of Carthage. There 
she was fated to experience unrequited love and a martyr’s death. 

This quote is from Stories about Maxima and Minima by V.M. Tikhomirov. We recom- 
mend this book, and Chapter VII of the classic What Is Mathematics? by R. Courant and 
H. Robbins, where several extremal problems arising in mathematics, physics, astronomy, 
and other areas are discussed. 
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9.3 The vibrating string 


The solution by d’ Alembert of the problem of the vibrating string was the beginning of the 
development of Fourier series. The connection is explained in this section. 

Just as we derived the Laplace equation for steady state heat conduction from a simple 
law—the Newton law of cooling—we can derive the equation governing the vibrations of 
a string using another simple law of Newton—the Second Law of Motion. 

Imagine a thin, long, stretched elastic string. If the length is much greater than the 
thickness we may think of it as a one-dimensional string stretched between points 0 and L 
on the x-axis. If it is plucked in the y direction and released, it will start vibrating. We 
assume that the tension of the string is high and the vibrations are small, all motion takes 
place in the x-y plane and all points of the string move perpendicular to the x-axis. These 
assumptions, no doubt, are simplistic but they describe the behaviour of a typical system— 
such as a musical instrument—fairly accurately. 

Let u(x,t) describe the profile of the string, i.e., u(x,t) is the displacement in the 
y-direction at time ¢ of a point which was originally at point x in the equilibrium posi- 
tion. 

Consider a small portion of the string between the points a and b, a < b. If p is the den- 
sity of the string, the mass of this portion is p(b — a) and its acceleration is approximately 
3u Jat? evaluated at some point x, a < x < b. So, by Newton’s second law of motion the 
force acting on this portion of the string is 


f =pb- a). (5.16) 


We can also calculate this force by another argument. This force arises from the tension T 
of the string. We can assume r is constant when vibrations are small. This force acts along 
the string. Its component in the y-direction is obtained by multiplying it by the sine of the 
angle of inclination, and this is [1 + (/4x)?]~'/2du/dx. Therefore, if 8u/4x is much 
smaller than 1, as is the case when the vibrations are small, this is nearly equal to du/dx. 
So the total force acting on the portion of the string between a, b is approximately 


f=t=— x (5.17) 


Now equate (5.16) and (5.17), divide by b — a and let b — a. This gives 


Oru ak 3u 
3? p ax? 


This is usually written as 


9 9 
Onu ,07U 


a (5.18) 
a axe 


and called the one-dimensional wave equation. 


Remark 5.3.1. Note that by a “dimension analysis” we can see what the factor a in (5.18) 
represents. The units of t are those of force, i.e, mass x length x (time)~?, the units of p 
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are those of density, i.e., mass x (length)~!. So t/p has the units of (length)? x (time)~?, 
i.e., of (velocity). Thus a is a quantity like a velocity. This can be seen by analysing (5.18) 
also. We will find this information useful, even though it does not affect any mathemati- 
cal calculation. In fact, in several mathematics books you will find the statement “a is a 
constant, which may be put equal to | without loss of generality.” 


In addition to (5.18) our system satisfies the boundary conditions 
u(O,t) =u(L.t) =0 forall t. (5.19) 


This says that the end points of the string are fixed throughout the motion. The initial 
position and velocity can be chosen at will. This is stated as initial conditions 


u(x, 0) = f(x). t(x, 0) = g(x), (5.20) 


where f and g describe the initial position and the initial velocity of a particle on the string 
at the position x. Since we are assuming that u satisfies (5.18), both f and g must be C° 
functions (at least piecewise C°). 

The problem is to find u that satisfies (5.18) —(5.20). 

One way is to proceed as in Section 1.2 where we studied the heat problem. Assume 
that there is a solution of the form 


u(x,t) = X(x)T(t), (5.21) 
where X is a function of x only and T is a function t only. Then (5.18) leads to the equation 
x” 1 T" 
X aT 
Since the left-hand side is independent of t, and the right-hand side is independent of x, 
there is a constant c such that 
x” l T" 
r r T 
X a-T 


This leads to two second order ordinary differential equations 


X" +cX=0, 
T" tarcT =0. (5.22) 


Both equations are of the type (1.6) encountered earlier. 
When c = Q, the equations (5.22) lead to the solution 


u(x,t) = (Ax + B)(Ct + D), 


where A, B, C, D are constants. Now if C Æ 0, u(x,t) becomes unbounded as t > oo. 
We know from physical considerations that u must remain bounded. So C = 0. This means 
that v is independent of 1. So there cannot be any motion. This is contrary to what we know. 
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If c Æ 0, then proceeding as in Section 1.2 we get the solution 
u(x,t) = (Ae + Be) Cell 4 Dew), (5.23) 


where a = /c, p = ca and A, B. C, D are constants. If c > 0, then both a, £ are real 
and we can assume without loss of generality that both are positive—otherwise we can 
interchange A and B. and C and D. If c < 0, then both a, are imaginary. 

From the first condition in (5.19), and (5.23) we get 


0 = u(0. t) = (A+ BCe!’ + Dei") 


for all t. If the second factor on the right-hand side were zero, then u(x, t) would be iden- 
tically zero. This is not possible. Hence 


A=-B. (5.24) 
Now using the second of the boundary conditions (5.19), (5.23), and (5.24) we get 
Alt — dle) — 9, (5.25) 
If c < 0, then a = iy for some real y Æ 0. and (5.25) becomes 
Ale — el) =0, 


which implies A = 0 and hence from (5.24) B = 0 as well. Again. this would mean that 
u(x, t) is identically zero, and that is not possible. 
So, we are left with the case c > 0. Now æ is real and positive, and (5.25) gives 


A sin La = 0. 


Since A cannot be zero (as we saw above) this condition implies that 


Then we must have 


Hence for each positive integer n we have a solution of (5.18) given by 
Un(x, t) = sin (Ane Bae); (5.26) 


where A,,, Bn are some (new) constants and w = zra/L. 
A finite linear sum of such u» would be a solution of (5.20) and so would be the infinite 


sum 


Fs = . ATX intw —intut (5 27) 
u(x,t) = Š sin Ta ne + Bne J, 2 


n=l 


provided this series is convergent and can be differentiated term by term. 
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Exercise 5.3.2. Show that the assumption u € C 2 implies that the series (5.27) converges 
uniformly and can be differentiated term by term. 

The arbitrary constants A, and B, occurring in (5.27) are determined from the initial 
condition (5.20). These give 


a nX 
F(x) = X (An + Bn) sin Ea 
n=l 


= nax 
g(x) = Y inw(Ay — By)sin (5.28) 


n=l 


Thus A, + B, and inw(A, — Bn) are the coefficients in the Fourier sine series for f and g 
respectively. So, they are determined uniquely by f and g. Hence A,, and B, are uniquely 
determined by f and g. 


Remark 5.3.3. Since the quantity a is a velocity, as observed earlier, the quantity w has 
the units of velocity x (length)~' = (time)~!. Thus w can be thought of as a frequency. 
Our solution (5.27) involves positive integral multiples nw of this frequency. In music w 
is called the fundamental and 2w, 3w, ... are called the overtones. Note that 


T 1 ft 
w = —a = — | —. 
L LY p 


So w increases with tension and decreases with the length and the density of the string. 
This corresponds well with our practical experience. 

D*Alembert’s original solution was different from (5.27). We can get it from (5.27) as 
follows. Expand the exponentials occuring there into cosines and sines, then use familiar 
trigonometric identities to get (5.27) into the form 


] X - 
u(x,t) = 5 X (An + Bn) [sin (F +ntw) + sin (“= — ntw) | 


— : X iln — Bn) [cos (= +ntw) — cos (= — ntw) | . 


Now, replace w by x L/a and rearrange terms to get 
l >. AR : nyt 
Wi = 5). [(An + Bn)sin T (at +2) ~i(An — By) cos (at +2)] 


l . AR f 
-3 Do [Cn + Br) sin T_ (at =x) ~ (An — By) cos (at — x)]. (6.29) 
So, one can write 
u(x,t) = v(at +.x) — v(at — x) (5.30) 


where v is defined by (5.29) and (5.30). Note that v is a function of one variable. 
D’Alembert’s solution was given in the form (5.30). It is not necessary to come to it via 
the route followed above. A much simpler way is the following. Let v be any C? function 
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of period 2L. Then if we define u(x. t) by (5.30), we can easily check that it satisfies the 
wave equation (5.18), and also the boundary conditions (5.19). If u(x, t) is now to satisfy 
the initial conditions (5.20), then we must have 


f(x) = u(x, 0) = v(x) — v(-x), 
g(x) = u(x, 0) = v(x) — v'(—x). 


These two conditions completely determine v; the first one determines the odd part of v 
and the second determines its even part. 

Notice that (5.30) can be interpreted as a superposition of two waves travelling in the 
opposite direction with the same speed a. As a function of x, the graph of v(at + x) has 
the same shape as that of v(x) but is translated by a distance at to the left. This can be 
thought of as a wave travelling to the left with speed a. The point 0 on the string is fixed. 
The function —u(at — x) represents the wave v(at + x) reflected at the origin, and now 
travelling to the right with speed a. The solution (5.30) is a superposition of these two 
waves. 


5.4 Band matrices 


In this section we demonstrate an application of ideas from Fourier series to a problem in 
linear algebra. 

Let M(n) be the space of n x n complex matrices. A matrix A is also a linear operator 
on the Euclidean space C”. The norm of A is its norm as an operator, defined as 


All = sup{||Ax|] : x € C”, [xi] = 1). (5.31) 


An operator U is said to be unitary if it satisfies any of the following equivalent conditions: 


1. U preserves inner products, i.e., (Ux, Uy) = (x, y) forall x, y, € C”. 

2. U preserves norms, i.e., ||Ux|| = [|x|] for all x € C”. 

3. U is invertible, and (its Hermitian conjugate) U* = U -l1; ie. UU* = U*U = 1, the 
identity Operator. 

4. For each orthonormal basis e1... ., €n in C”, the vectors Ue,..., Uen also form an 
orthonormal basis. 


It is easy to See that 


UAV] = [|All forall unitary U, V. (5.32) 


Exercise 5.4.1. Let w = e2"*/", a primitive nth root of unity. For 0 < j < n — 1, let fj 
be the n-vector with components 


jk 0<k<n-l1. 


l 
fr = RI , 
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Thus 


etc. Show that fo, fi,..-. fn—1 is an orthonormal basis for C”. Show that the matrix F 
whose jth column is the vector f}; is a unitary matrix. 


Exercise 5.4.2. The permutation matrix 


0 0 -. I 
1 0 --- 0 
R=] 0 1 0 
00 1 0 


is unitary. Let F be the matrix of Exercise 5.4.1 and let U = FRF*. Show that U is the 
diagonal unitary matrix with diagonal entries 1,w,...,@"—', i.e., 


U = diag(1, a, a a (5.33) 


Exercise 5.4.3. A few important facts of Linear Algebra are listed in this exercise. Prove 
them. 


(i) The Spectral Theorem says that every Hermitian operator (one for which A = A*) 
can be diagonalised by a “unitary conjugation”; i.c., there exists a unitary U such that 


U AU* = diag(A1, eee An). 
The numbers A ; are the eigenvalues of A. So, for a Hermitian operator, 
|All = max [Aj]. 
I<jsu 
(ii) For any operator A we have || Al]? = ||A* Al]. 
(iii) The positive square roots of the eigenvalues of A are called the singular values of A. 


They are enumerated in decreasing order as sı (A) > s2(A) > --- > s,(A). We have 
All = sı (A). 


Exercise 5.4.4. Calculate the norms of the 2 x 2 matrices 
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You will find that Al] = V2. and || Bll = (1 + 5). In this example, B is obtained by 
replacing one of the entries of A by zero. But || BI] > |JAll. 


The rest of this section is concerned with finding relationships between || Bl] and || Al 
when B is obtained from A by replacing some of its entries by zeros. 

Divide A into r? blocks in which the diagonal blocks are square matrices, not neces- 
sarily of the same sizes. The block-diagonal matrix obtained by replacing the off-diagonal 
blocks A;j. i Æ j, by zeros is called a pinching (an r-pinching) of A. We write this as 


C(A) = diag(At|..... Arr). (5.34) 


Thus a 2-pinching is obtained by splitting A as [Ajj], i. j = 1. 2, and then putting 


= All 0 
cca) =| 0 a (5.35) 


Exercise 5.4.5. 


(i) Let U be the block-diagonal matrix U = diag(/, —/) where the blocks have the same 
sizes as in the decomposition (5.35). Show that the 2-pinching 


C(A) = LA + UAU"). (5.36) 


Hence C(A) < |All. 

(ii) Show that the r-pinching (5.34) can be obtained from A by successively applying 
(r — 1) 2-pinchings. Thus C(A) < [|All for every pinching. 

(iii) Show that there exist” mutually orthogonal projections Pj in C", Pj +--+ + Pr = 1. 
such that the pinching (5.34) can be written as 


i 
C(A) = ) PjAP). (5.37) 
j=l 


When r = n. the pinching (5.34) reduces to a diagonal matrix. We write this as D(A) 
and call it the diagonal part of A. In this case the projections Pj in (5.37) are the projections 
onto the |-dimensional spaces spanned by the basis vectors. 


Exercise 5.4.6. 


(i) Let U be the diagonal unitary matrix (5.33). Show that 


n—-l 


D(A) = i ». UJ AU". (5.38) 
i—0 


(ii) Any r-pinching can be described as 


r-l 


l . f 
=- VIAV* (5.39) 
C(A) = = 32 


where V is a diagonal unitary matrix. What is V? 
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(iii) Use this representation to give another proof of the inequality [C(A] < IIA]. 


The expressions (5.37) and (5.39) display a pinching as a (noncommutative) averaging 
operation or a convex combination of unitary conjugates of A. 

For | < j < n-— 1, let Dj(A) be the matrix obtained from A by replacing all its entries 
except those on the jth superdiagonal by zeros. (A superdiagonal is a diagonal parallel to 
the main diagonal and above it.) Likewise, let Dj (A) be the matrix obtained by retaining 
only the jth subdiagonal of A. In consonance with this notation we say Do(A) = D(A). 

Let Uo be the diagonal matrix 


The (r, s) entry of the matrix Ug AU, is then ei- a,,. Hence 


1 a 
D(A) = — | e° Ua AUG dO. (5.40) 
ch Jar 
When k = 0, this gives one more representation of the main diagonal D(A) as an average 
over unitary conjugates of A. From this we get the inequality ||D,(A)|| < IA]. Using 
(5.40) we see that 


n 


l 
IDk(A) + D-K(A)l < 5 f l2coskê| doia. 
at J-n 


Let 73(A) = D-1 (A) + Do(A) + Dı (A). This is the matrix obtained from A by keeping 
its middle three diagonals and replacing the other entries by zeros. Again, using (5.40) we 
see that 


n 


l 
IBA) < z) |! +2cos0]dðNAll. 
= yt 


Exercise 5.4.7. Calculate the last two integrals. You will get 
4 
D(A) + D-(A)I| < = WAI, (5.41) 
1 2/3 
IZA) < (; + =) IAI. (5.42) 


Note that using the inequality ||D}(A)|| < ||Al] and the triangle inequality we get the 
bounds 2/|Alj and 3]| Aj]. respectively, for the left-hand sides of (5.41) and (5.42). These 
bounds are weaker than what we have obtained from the integrals. 

A trimming of A is a matrix of the form 


k 
T+ (A) = È` Dj(A), 
j=—k 
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obtained by replacing all diagonals of A outside the band —k < j < k by zeros. We have 


n 
Tk+ı (A) =| Dx(@)Uy AUG dé, 


-7 


where D,(@) is the Dirichlet kernel (2.6). Hence. we have 


lZ (All < Lll All. (5.43) 


where Ly is the Lebesgue constant. Since L} = O(log k) this inequality is much stronger 
than the inequality ||7,44,(A)]| < (2k + 1)||Alj that one gets by using just the triangle 
inequality and |D; (A)| < [lA]. 

Let Ay (A) be the matrix obtained from A by replacing all entries of A below the main 
diagonal by zeros. Then Ay is called the triangular truncation operator. 


Exercise 5.4.8. 


(i) Let B beak x k matrix and let 
O B* 
A= . 
[so] 
This is a matrix of order 2k. Show that || Al] = ĮIBIl. 
(ii) Show that 


Tasot =| J Au(B) |. 


Au(B) O 
(iii) Thus, if Ay is the triangular truncation operator on M (k), then 
Au(B)|] < Les Bil, (5.44) 


where Lg+1 is the Lebesgue constant. 


Let A be the k x k matrix with entries aj = (i - p> ifi Æ j, and aj = Q. It 
can be seen (with some labour) that ||A|| < 7, while ||Ay(A)|| = O(logk). Thus the 
inequality (5.44) is nearly the best possible. This is an important fact. It corresponds to a 
basic fact about Fourier series proved by M. Riesz. The analytic part of a Fourier series 
reco Ane”? is the truncated series )°°° g dne!”®. Riesz showed that the truncation map 
that sends the Fourier series of a function to its analytic part is a bounded map on the 
space Lp if | < p < 00, but not if p = I or œ. 

The matrix F of Exercise 5.4.1 is called the matrix of the Finite Fourier Transform, a 
concept intimately related to Fourier series. 


Recommended supplementary reading for this section: M.-D. Choi, Tricks or treats with 
the Hilbert matrix, American Mathematical Monthly, Volume 90, May 1983, pp. 301- 
312; and R. Bhatia, Pinching, trimming, truncating and averaging of matrices, American 
Mathematical Monthly, Volume 107, August-September 2000, pp. 602-608. 


A Note on Normalisation 


One peculiar feature of writings on Fourier analysis is that the factor 27 is placed at differ- 
ent places by different authors. While no essential feature of the theory changes because of 
it, this is often confusing. You should note that we have used the following notations: 


1. The Fourier coefficients of f are defined as 
F l . —in8 
f(a)= z. f(@)e dé. 


2. The convolution of f and g is defined as 


n 


(f *g)(x)= fœ -—teglt)dt. 


3. The Dirichlet kernel is defined as 
N 


l y 
D) =z De 


n=—N 


4. For functions on a bounded interval Z we have defined L2 and Lı norms as 


= l EVA Dy ae 
i= (j | IFO) dx) 


I 
Ti Í If œ) dx, 


where |/| is the length of the interval /. . 
When you read other books you should check whether the Same conventions are being 


followed. For example, some authors may not put in the factor 1 /|/ | while defining norms, 
others may put in the factor 1/27 while defining f * g. Then some of their theorems will 
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look different because the factor 27 if suppressed at one place will appear elsewhere. See 
the remark following Theorem 4.2.4. 

As a consolation we might note that in spite of several international conferences on 
“units and nomenclatures” many engineering texts use—sometimes on the same page— 
the f.p.s., the c.g.s., the m.k.s. and the rationalised m.k.s. systems of units. 


A Brief Bibliography 


This is a brief bibliography. Some of the books listed here provide the necessary back- 
ground. Others are suggested as collateral and further reading. 


Analysis 


Several generations of mathematics students have learnt their analysis from the classic 


W. Rudin, Principles of Mathematical Analysis, McGraw Hill, first published in 
1953, 3rd ed., 1976. 


Chapters 1-8 of Rudin provide adequate preparation for reading most of this book. For 
some of the sections more advanced facts about integration are needed. These may be 
found in Chapter 10 of Rudin, and in greater detail in Part | of another famous text: 


H. L. Royden, Real Analysis, MacMillan, 3rd ed., 1988. 


Elementary facts about differential equations that we have used in this book are gener- 
ally taught as applications of the Calculus. These may be found. for example. in 


R. Courant, Differential and Integral Calculus, 2 volumes, Wiley Classics Library 
Edition, 1988. 


or, in 


W. Kaplan, Advanced Calculus, Pearson Addison-Wesley. 5th cd.. 2002. 
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For a more detailed study of differential equations the reader may see 


W. E. Boyce and R. C. DiPrima, Elementary Differential Equations and Boundary 
Value Problems, 7th ed., Wiley Text Books, 2002. 


Chapter 10 of this book, titled “Partial differential equations and Fourier Series.” con- 
tains topics close to the ones we have studied in the early sections. 

We have used elementary properties of complex numbers and functions in this book. 
At places we have pointed out connections with deeper facts in Complex Analysis. The 
standard reference for this is 


L. V. Ahlfors, Complex Analysis, 3rd ed., McGraw Hill, 1978. 


Fourier series 


Two well-known books on Fourier series, available in inexpensive editions. are 


H.S. Carslaw, Introduction to the theory of Fourier’s Series and Integrals, Dover 
Publications, 1952, 


and 


G.H. Hardy and W.W. Rogosinski, Fourier Series, Cambridge University Press, 
1944. 


Less well known and, unfortunately, not easily available is the excellent little book 


R.T. Seeley, An Introduction to Fourier Series and Integrals, W.A. Benjamin Co., 
1966. 


Our beginning sections are greatly influenced by, and closely follow, Seeley’s approach. A 
more recent book which is very pleasant reading is 


T.W. Körner, Fourier Analysis, Cambridge University Press, paperback edition, 
1989. 


All these books are at an intermediate level. More advanced books, for which a thorough 
knowledge of functional analysis is essential include 


H. Helson, Harmonic Analysis, Hindustan Book Agency, 1995, 
Y. Katznelson, An Introduction to Harmonic Analysis, Dover Publications, 1976, 
and 


H. Dym and H.P. McKean. Fourier Series and Integrals, Academic Press, 1972. 
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General reading 


We have emphasized the history of Fourier Series and their connections with other subjects. 
The following books were mentioned in the text. 


W. Dunham, Journey Through Genius, Penguin Books, 1991. 


W. Dunham, Euler: The Master of Us All, Mathematical Association of America, 
1999. 


V. M. Tikhomirov, Stories about Maxima and Minima, American Mathematical So- 
ciety, 1990. 


E. Maor, Trigonometric Delights, Princeton University Press, 1998. 
J. Arndt and C. Haenel, x Unleashed, Springer, 2001. 


A. Weil, Number Theory: An Approach Through History from Hammurapi to Legen- 
dre, Birkhauser, 1984. 


History and biography 


The recent book 


J.-P. Kahane and P.-G. Lemarié-Rieuseet, Fourier Series and Wavelets, Gordon and 
Breach, 1995 


provides a scholarly history of Fourier Analysis and also a treatment of more recent topics. 

Fourier’s original book Théorie Analytique de la Chaleur has been translated into En- 
glish as The Analytical Theory of Heat published in a paperback edition by Dover. It is 
regarded as both a scientific and a literary masterpiece. A biography of Fourier is con- 
tained in the famous book Men of Mathematics by E.T. Bell, Simon and Schuster, 1937. A 
scholarly full length biography is Joseph Fourier, The Man and the Physicist by J. Heriv- 
ell, Oxford, 1975. A few facts about Fourier may induce you to look at these books. He 
was a revolutionary, accused of being a “terrorist” and was almost killed on that charge; 
he was a soldier in Napoleon’s army that invaded Egypt and later a successful governor of 
a province in France; he wrote a survey of Egyptian history that has been acknowledged 
as an outstanding work by historians; he was the Director of the Statistical Bureau of the 
Seine and is known among demographers for his role in developing governmental statistics 
in France; his book on heat propagation has been repeatedly published as a part of “Great 
Books” collections by several publishers. A most striking counterexample to the common 
belief that a scientist is someone forever bent over his equipment or papers, oblivious of 
and indifferent to the world around. 
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... if man wishes to know the aspect of the heav- 
ens at successive epochs separated by a great 
number of centuries, if the actions of gravity and 
of heat are exerted in the interior of the earth at 
depths which will always be inaccessible, math- 
ematical analysis can yet lay hold of the laws of 
these phenomena. It makes them present and mea- 
surable, and seems to be a faculty of the human 
mind destined to supplement the shortness of life 
and the imperfection of the senses; and what is 
still more remarkable, it follows the same course 
in the study of all phenomena; it interprets them 
by the same language, as if to attest the unity and 
simplicity of the plan of the universe, and to make 
still more evident that unchangeable order which 
presides over all natural causes. 


Joseph Fourier 
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function (continued) Poisson integral, 20 
absolutely continuous, 44 Poisson kernel, 20 
bounded variation, 41 Poisson's theorem, 23 
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